-- Logs begin at Fri 2022-09-09 03:59:36 UTC, end at Fri 2022-09-09 04:40:13 UTC. -- Sep 09 04:24:25.861254 dv-cinder-856002-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 04:24:25.868582 dv-cinder-856002-3-smb devstack@keystone.service[81475]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 04:24:25 2022] *** Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: nodename: dv-cinder-856002-3-smb Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: machine: x86_64 Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: clock source: unix Sep 09 04:24:25.870584 dv-cinder-856002-3-smb devstack@keystone.service[81475]: pcre jit disabled Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: detected number of CPU cores: 4 Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: current working directory: / Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: detected binary path: /usr/bin/uwsgi-core Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: your processes number limit is 47680 Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: your memory page size is 4096 bytes Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: detected max file descriptor number: 2048 Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: lock engine: pthread robust mutexes Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: thunder lock: enabled Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 04:24:25.871030 dv-cinder-856002-3-smb devstack@keystone.service[81475]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 04:24:25.911388 dv-cinder-856002-3-smb devstack@keystone.service[81475]: Python main interpreter initialized at 0x56477f3b79c0 Sep 09 04:24:25.911388 dv-cinder-856002-3-smb devstack@keystone.service[81475]: python threads support enabled Sep 09 04:24:25.911388 dv-cinder-856002-3-smb devstack@keystone.service[81475]: your server socket listen backlog is limited to 100 connections Sep 09 04:24:25.911388 dv-cinder-856002-3-smb devstack@keystone.service[81475]: your mercy for graceful operations on workers is 90 seconds Sep 09 04:24:25.911785 dv-cinder-856002-3-smb devstack@keystone.service[81475]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 04:24:25.911867 dv-cinder-856002-3-smb devstack@keystone.service[81475]: *** Operational MODE: preforking *** Sep 09 04:24:25.912122 dv-cinder-856002-3-smb devstack@keystone.service[81475]: *** uWSGI is running in multiple interpreter mode *** Sep 09 04:24:25.912122 dv-cinder-856002-3-smb devstack@keystone.service[81475]: spawned uWSGI master process (pid: 81475) Sep 09 04:24:25.912326 dv-cinder-856002-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 04:24:25.913431 dv-cinder-856002-3-smb devstack@keystone.service[81475]: spawned uWSGI worker 1 (pid: 81488, cores: 1) Sep 09 04:24:25.913431 dv-cinder-856002-3-smb devstack@keystone.service[81475]: spawned uWSGI worker 2 (pid: 81489, cores: 1) Sep 09 04:24:25.913431 dv-cinder-856002-3-smb devstack@keystone.service[81475]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 04:24:30.198411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:24:30.198411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: from cryptography.utils import int_from_bytes Sep 09 04:24:30.199219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:24:30.199219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: from cryptography.utils import int_from_bytes Sep 09 04:24:30.200013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:24:30.200013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: from cryptography.utils import int_from_bytes Sep 09 04:24:30.200468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:24:30.200468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: from cryptography.utils import int_from_bytes Sep 09 04:24:30.249680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 04:24:30.250461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 04:24:30.250606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] command line args: [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 04:24:30.250874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 04:24:30.251052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ================================================================================ {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 04:24:30.251330 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] admin_token = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.251485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 04:24:30.251567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] config_dir = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.251681 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 04:24:30.251767 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.251873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] command line args: [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 04:24:30.251961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] config_source = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.252088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] debug = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.252215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 04:24:30.252288 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.252577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ================================================================================ {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 04:24:30.252577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] admin_token = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.252777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.252882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] config_dir = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.252984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253085 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253284 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] config_source = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] debug = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_config_append = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.253986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254091 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_dir = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_file = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254625 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.254905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_config_append = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_dir = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255445 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_file = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255562 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255562 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255758 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.255954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256035 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256116 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.256994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257189 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257311 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257522 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.257835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] publish_errors = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.258846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259189 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259311 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] publish_errors = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] standard_threads = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259783 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.259862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260096 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] use_journal = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] use_json = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260599 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] standard_threads = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260676 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] use_stderr = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.260909 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] use_syslog = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261094 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.261409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] use_journal = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] use_json = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.261686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] use_stderr = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.261803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.261881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] use_syslog = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.262064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.262155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:24:30.262293 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.262371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.262533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.262610 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.262784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.262869 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.263866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264092 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.264974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.265060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.265212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.265294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.265992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266081 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.266921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.267972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268087 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268452 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268681 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268795 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.268908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269270 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269384 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.269980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270562 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270562 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.270789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271767 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.271881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.272985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273099 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273324 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273683 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273797 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.273910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274258 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274594 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274707 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.274949 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275191 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275417 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275780 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.275911 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.276890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277701 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.277944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278389 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.278929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.279189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.279440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.279678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.279916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.280160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.280399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.280647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.280884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.281691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.281928 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.282237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.282498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.282620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.282778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.282904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283550 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.283917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284161 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284404 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.284996 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285822 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.285938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286052 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286596 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286711 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286828 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.286942 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.287950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.external = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.288891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.password = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289006 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] auth.token = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.289942 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290063 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290342 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290595 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.290954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291576 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.291931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292165 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292396 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292638 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.external = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.292988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293829 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.password = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.293944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] auth.token = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294764 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.294882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.295964 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296546 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.296972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297546 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.297793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298474 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.298946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299065 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299194 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299796 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.299913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.300935 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301302 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301425 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301541 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301783 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.301908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302264 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302738 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.302970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303085 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.303932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304061 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304179 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.304996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305112 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305342 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.305932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306288 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306518 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306518 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306867 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.306985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307120 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.307933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.308047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.308161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.308286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.308404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.308766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.308886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.309946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310063 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310293 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310764 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.310993 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311148 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311746 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.311985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.312937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.313979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314104 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314571 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314810 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.314928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315043 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315546 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.315889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316592 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.316955 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.317894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318125 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318371 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318489 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.318951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319075 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319241 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319357 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.319949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320065 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320179 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320649 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320764 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.320995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] role.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] role.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.321937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322170 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322284 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.322985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323317 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323553 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.323902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324145 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324738 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324738 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.324958 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325547 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.325893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326133 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] role.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] role.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.326954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327213 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327444 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.327814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.328501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.328638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.328755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.328894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329070 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329194 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329311 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.329888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330479 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330718 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.330993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331486 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.331959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.332956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333432 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333547 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333788 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.333918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334262 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334380 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.connection = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334612 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334847 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.334961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335434 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.335920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336035 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336150 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336395 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.336990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337453 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.337926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338271 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338512 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 04:24:30.338963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.338963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.339581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.connection = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.339581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.339581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.339900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.340023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.340184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.340421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.340657 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.340892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.341137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.341373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.341617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.341853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.342102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.342337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.342581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.342812 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.343053 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.343312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:24:30.343530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 04:24:30.367733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.367964 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.368190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.368901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.369134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.369358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.376717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.377848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.405304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.405534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.406694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.406951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.459595 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.460745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.508178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.508411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.509072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.509309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.664426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.664612 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.664756 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.664838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.664936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665095 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.665671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689694 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.689993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.690127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.690209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.690338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.690418 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.690548 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.690637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.701708 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.701915 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.714564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.714721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.714809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.714967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715434 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715731 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.715945 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.716079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 04:24:30.733124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.733335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 04:24:30.733574 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.733680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.733787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 04:24:30.733883 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 04:24:30.734177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.734263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.734382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 04:24:30.734553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.734661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.734820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.734927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.735082 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.735219 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.735483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.744679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.744961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.745042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.745232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.745313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.745514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.745596 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.745847 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.753157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.753380 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.756073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.756301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.756382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.756593 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.756673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.756880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.757977 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.758867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.759057 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.782220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.782400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.783743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.783898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.784030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.784186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.788788 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.788879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.789073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.789153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.789356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.789437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.795735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.795816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.796026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.796105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.801745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.801879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.802042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.802173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.802332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.802458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.802621 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.802741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.802902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.803864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.819918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.820198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.820279 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.820476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.824017 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.824289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.827227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.827505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.827590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.827977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.831910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.832300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.835112 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.835383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.838342 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.838538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.838647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.838839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.838920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.839150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.839244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.839441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.839522 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.839724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.839804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.840005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.856259 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.856359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.856550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.856631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.856821 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.856916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.857089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.857175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.864096 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.864187 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.865651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.865783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.867197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.867281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.867479 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.867560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.870135 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.870216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.870429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.870509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.870713 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.870802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.870997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.871077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.871419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.871502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.883069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.883233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.883379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.883522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.883666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.883805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.883950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.884090 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.884338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.884472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.884629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.884769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.884912 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.885041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.900328 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.900623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.903252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.903558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.906671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.907068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.908252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.908544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.909720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.910004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.910083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.910286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.910407 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.910689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.916819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.917156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.918276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.918610 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.921186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.921527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.921637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.921970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.922093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.922258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.922384 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.922538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.930233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.930363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.930529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.930655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.930814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.930939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.937999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.938191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 04:24:30.938275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.938480 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.938561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.938802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.938893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939035 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.939968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.940980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.941066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.941241 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.941319 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.941517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.941596 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.941800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 04:24:30.976388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56477f3b79c0 pid: 81488 (default app) Sep 09 04:24:30.976809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56477f3b79c0 pid: 81489 (default app) Sep 09 04:24:30.979806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32ca3-81d5-4cd9-bf34-dbd63e815ec4 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:30.980097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32ca3-81d5-4cd9-bf34-dbd63e815ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:30.980371 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32ca3-81d5-4cd9-bf34-dbd63e815ec4 None None] PATH_INFO: `/v3` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:30.985139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Fri Sep 9 04:24:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:37.791465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:37.791973 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:37.792078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:37.796335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:24:37.802096 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:37.802542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:37.802681 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:37.873237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: INFO dbcounter [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] Registered counter for database keystone Sep 09 04:24:37.892785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG oslo_db.sqlalchemy.engines [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:24:37.898984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writer thread running {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:24:38.075429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG passlib.handlers.bcrypt [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81488) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 04:24:38.075730 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG passlib.handlers.bcrypt [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81488) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 04:24:38.133570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:38.135210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:38.261411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 04:24:38.548893 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:38.618829 dv-cinder-856002-3-smb devstack@keystone.service[81489]: INFO dbcounter [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] Registered counter for database keystone Sep 09 04:24:38.639660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:24:38.646868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writer thread running {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:24:38.765932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8df82-53c9-4810-86b7-fcb4435bd0a4 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:38.770083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:38.770703 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:38.770983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:38.771281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:38.779479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:38.831878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 04:24:38.832403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197380a-166c-4354-b9d8-717ece61f4eb admin admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:38.841312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Fri Sep 9 04:24:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 04:24:38.847877 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:38.864238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090100d0-bac6-46e6-a235-7e26a70d5920 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:38.868507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:38.869619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:38.869899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:38.870165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] PATH_INFO: `/v3/projects/2ce92404f91b4778925ef74e27275875` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:38.871758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ce92404f91b4778925ef74e27275875)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:38.925701 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 04:24:38.926038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b897bc-bd7e-4cbd-b5b2-9ca82df5efd2 admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:38.930504 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Fri Sep 9 04:24:38 2022] GET /identity/v3/projects/2ce92404f91b4778925ef74e27275875 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:41.052137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367add-c06c-44d7-8e85-fab92126080a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:41.052649 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367add-c06c-44d7-8e85-fab92126080a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:41.052730 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367add-c06c-44d7-8e85-fab92126080a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:41.056815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:41.063295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:41.063717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:41.063844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:41.084098 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:41.085603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:41.093404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 04:24:41.364708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367add-c06c-44d7-8e85-fab92126080a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:41.377308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367add-c06c-44d7-8e85-fab92126080a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:41.381472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057c2f7-e20a-4c13-aafb-a87df398977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:41.382068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057c2f7-e20a-4c13-aafb-a87df398977e admin admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:41.382350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057c2f7-e20a-4c13-aafb-a87df398977e admin admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:41.382624 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057c2f7-e20a-4c13-aafb-a87df398977e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:41.390700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057c2f7-e20a-4c13-aafb-a87df398977e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:41.392506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057c2f7-e20a-4c13-aafb-a87df398977e admin admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:41.401268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Fri Sep 9 04:24:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 04:24:41.406624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:41.415570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9818c-78a6-4a6e-8bdf-3f6578eab513 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:41.419793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e82a8-5c2f-46f8-96d0-c4ee0e6a29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:41.420409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e82a8-5c2f-46f8-96d0-c4ee0e6a29ea admin admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:41.420688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e82a8-5c2f-46f8-96d0-c4ee0e6a29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:41.420957 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e82a8-5c2f-46f8-96d0-c4ee0e6a29ea admin admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:41.422855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e82a8-5c2f-46f8-96d0-c4ee0e6a29ea admin admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:41.424705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e82a8-5c2f-46f8-96d0-c4ee0e6a29ea admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:41.426192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Fri Sep 9 04:24:41 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:43.651863 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579a4cf-ce97-4a29-8a73-2a8faa857cce None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:43.652366 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579a4cf-ce97-4a29-8a73-2a8faa857cce None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:43.652366 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579a4cf-ce97-4a29-8a73-2a8faa857cce None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:43.653648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:43.659343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:43.659773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:43.659899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:43.665327 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184306-29a4-4b0b-bd5b-42d56b36ea28 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:43.665611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184306-29a4-4b0b-bd5b-42d56b36ea28 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:43.665886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184306-29a4-4b0b-bd5b-42d56b36ea28 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:43.667151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:24:43.672949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:43.673234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:43.673509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:43.678982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:43.680178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:43.715560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG passlib.handlers.bcrypt [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81489) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 04:24:43.716043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG passlib.handlers.bcrypt [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81489) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 04:24:43.761110 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:43.767161 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:43.768823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:43.868470 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:24:44.029151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.052944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.133555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd354113-2ec6-4902-b31c-7f6ddd309192 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.137656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.167188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.167830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.168100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.168387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.179910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:24:44.189841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:24:44.190770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:24:44.191875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:24:44.196698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.241481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234c2f-9025-4ab5-bfa5-b608d63edbcc None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.244245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.280263 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.281197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.281474 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.281580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.281747 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.300220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9e13e-8877-4d06-b240-ffd088e19fbf None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.334475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.335101 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.335410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.335672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.336345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:44.336646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.338054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.350002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.350287 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:44.351619 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.355934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.449114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:24:44.453474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9239a93-941e-4f88-b3f1-b84858daec36 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.455368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.458051 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.488963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.489601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.489884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.490161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.491331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.492804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.494379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:44.500404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.514299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.553964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430a0f1-1193-4ed8-bb0a-939683417ead None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.587623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.588468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.588748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.589028 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.598171 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc18e-21a4-4251-8f6b-2d6d23fb50ed None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.607383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.609385 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:24:44.628063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:24:44.629123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:24:44.630142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:24:44.630142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:24:44.630142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:24:44.630142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:24:44.634800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.637513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.638924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.638924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.638924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.639848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.641826 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.643414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:44.649059 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:44.692801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.730021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:44.738106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e6c8-3bc0-4823-b8d2-27ef3d5a11c0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.750473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11a27-a473-4301-b20d-8f56135e678d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:44.771618 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.772220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.772540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.772798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.773438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:44.773748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.775133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e11ea-8002-42f4-a98c-7cdaffc03cf0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.786898 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:44.787543 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:44.787825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:44.788101 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:44.788825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.domain.id=default, user.id=408c4550159c4ddc8a18898824740b43) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:44.789136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:44.790583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6d6a-31e2-4837-9b0e-af88b38fe0cb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:44.792523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:44.797853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Fri Sep 9 04:24:44 2022] GET /identity/v3/role_assignments?user.id=408c4550159c4ddc8a18898824740b43&scope.domain.id=default&role.id=d4776e2384644965a0ae59d37530328f => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:47.136613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b9f28-cbdb-4db7-8130-6c1b01840404 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:47.137122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b9f28-cbdb-4db7-8130-6c1b01840404 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:47.137194 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b9f28-cbdb-4db7-8130-6c1b01840404 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:47.138485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:47.144411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a33dc-558c-409c-b2bd-db56d0bd68af None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:47.144857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a33dc-558c-409c-b2bd-db56d0bd68af None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:47.144956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a33dc-558c-409c-b2bd-db56d0bd68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:47.172277 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-0e1a33dc-558c-409c-b2bd-db56d0bd68af None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:47.173588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0e1a33dc-558c-409c-b2bd-db56d0bd68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:47.273386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:47.634551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc27af-4a40-4660-9140-ceb67a8c93fe None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:47.635297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc27af-4a40-4660-9140-ceb67a8c93fe None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:47.635784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc27af-4a40-4660-9140-ceb67a8c93fe None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:47.637650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:47.644524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120373a8-ef98-4650-8385-0128acb91193 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:47.645089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120373a8-ef98-4650-8385-0128acb91193 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:47.645567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120373a8-ef98-4650-8385-0128acb91193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:47.664379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-120373a8-ef98-4650-8385-0128acb91193 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:47.665880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-120373a8-ef98-4650-8385-0128acb91193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:47.754363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:24:47.789076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a95e39-6bc9-415f-85fe-657d3d3b6aea None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:47.789699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a95e39-6bc9-415f-85fe-657d3d3b6aea None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:47.790178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a95e39-6bc9-415f-85fe-657d3d3b6aea None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:47.791796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:47.799540 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897fdd1-fea8-4101-850a-aeb5a3e5992e None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:47.800157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897fdd1-fea8-4101-850a-aeb5a3e5992e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:47.800661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897fdd1-fea8-4101-850a-aeb5a3e5992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:47.811944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:47.827492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a897fdd1-fea8-4101-850a-aeb5a3e5992e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:47.829007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a897fdd1-fea8-4101-850a-aeb5a3e5992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:47.830196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a95e39-6bc9-415f-85fe-657d3d3b6aea None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:47.949032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:48.020768 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d6f6-34ab-45ba-a747-757f7a209d42 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.021074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d6f6-34ab-45ba-a747-757f7a209d42 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.021325 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d6f6-34ab-45ba-a747-757f7a209d42 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.022659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:24:48.028500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.028786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.029060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.038858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a95e39-6bc9-415f-85fe-657d3d3b6aea None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:48.069426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:48.070630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:48.083454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:48.117579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:48.118220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.118499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.118773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.146310 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:24:48.160446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:24:48.161288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:24:48.162046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:24:48.169258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:24:48.173294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:48.242873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:24:48.284539 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:48.348450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432d6f-77c2-4366-af9b-a88062f59e97 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:48.411816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:48.412443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.412725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.412992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.413665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:48.413977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:48.415379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:48.430274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:48.430877 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:48.435483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:48.481922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:48.511308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ec39-1e17-4376-bd46-50a2161c0c70 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:48.576619 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903a101-2bef-4933-873a-71975d24b603 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:48.581360 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:48.582336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.582620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.582889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.593536 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:48.595021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:24:48.613173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:24:48.614069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:24:48.614860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:24:48.614860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:24:48.614860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:24:48.614860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:24:48.616177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:48.628752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:48.629371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.629652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.629924 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.630597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:48.632018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:48.735423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9b92-f587-4a81-80a3-d38adcec61f7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:48.753585 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:48.773680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:48.774242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:48.774522 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:48.774800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:48.775984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:48.777508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:48.779309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:24:48 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:48.779840 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:48.786560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 16/34] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 9 04:24:48 2022] POST /identity/v3/roles => generated 225 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:24:48.787944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:48.955895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c9a9-089f-431d-8724-3e658def7939 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:48.981110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:48.986109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56607a69-faa0-4c2f-ac7d-5a760c5a7813 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:49.010702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d632-d794-4bb6-a9b1-8205ec350f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:49.012263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d632-d794-4bb6-a9b1-8205ec350f0d None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.013061 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d632-d794-4bb6-a9b1-8205ec350f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.013558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d632-d794-4bb6-a9b1-8205ec350f0d None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.014697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d632-d794-4bb6-a9b1-8205ec350f0d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:49.017896 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d632-d794-4bb6-a9b1-8205ec350f0d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:49.027975 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:49.028578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.028783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.029094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.029732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:49.030067 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:49.032226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:49.050784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 17/35] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:49.052170 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:49.169238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a461-7ef9-4c87-8700-62440945e2ae None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:49.177581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 19/36] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 9 04:24:48 2022] POST /identity/v3/roles => generated 219 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:24:49.179176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64300232-647d-43ff-ad14-819bda9871b0 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.179475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64300232-647d-43ff-ad14-819bda9871b0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.179751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64300232-647d-43ff-ad14-819bda9871b0 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.180976 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 20/37] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:49.181681 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64300232-647d-43ff-ad14-819bda9871b0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:49.213932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137b0a5-77b2-4361-a26d-1c958c757a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:49.213932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137b0a5-77b2-4361-a26d-1c958c757a15 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.213932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137b0a5-77b2-4361-a26d-1c958c757a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.213932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137b0a5-77b2-4361-a26d-1c958c757a15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.215365 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137b0a5-77b2-4361-a26d-1c958c757a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:49.216851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137b0a5-77b2-4361-a26d-1c958c757a15 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:49.218570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 18/38] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:49.220405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d71424-2393-4535-82ab-ef9ab1df8149 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.220689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d71424-2393-4535-82ab-ef9ab1df8149 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.221079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d71424-2393-4535-82ab-ef9ab1df8149 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.222698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 19/39] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:49.223942 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.224187 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.224520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.248267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:49.249347 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:49.250557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:49.274676 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:49.319653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64300232-647d-43ff-ad14-819bda9871b0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:49.337917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:49.339121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:49.372453 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb453198-045f-4fae-ae55-1f367c5065b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:49.373585 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453198-045f-4fae-ae55-1f367c5065b1 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.373876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453198-045f-4fae-ae55-1f367c5065b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.374834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453198-045f-4fae-ae55-1f367c5065b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.375745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb453198-045f-4fae-ae55-1f367c5065b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:49.378304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb453198-045f-4fae-ae55-1f367c5065b1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:49.416212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:24:49 2022] POST /identity/v3/projects => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:24:49.417778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.418292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.418768 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.477704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599fcc-b1c1-45bd-a8dc-7a335f1f74ac None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:49.523420 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:49.524112 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.524402 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.524681 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] PATH_INFO: `/v3/domains/default/users/408c4550159c4ddc8a18898824740b43/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.527042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=408c4550159c4ddc8a18898824740b43, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:49.528596 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:49.552622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1361 bytes} [Fri Sep 9 04:24:49 2022] PUT /identity/v3/domains/default/users/408c4550159c4ddc8a18898824740b43/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:24:49.568470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:49.570729 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:49.643214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:49.664723 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:49.666017 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:49.770623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1df89-98e6-46c9-9af6-6a50eac50668 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:49.806150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:49.806768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:49.807048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:49.807361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:49.808035 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:49.809686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:49.823962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 9 04:24:49 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:24:49.940932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:49.972649 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:50.051551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823902c7-eb53-4bf0-b446-2a65376f58b6 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:50.087368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b6d91-f079-454a-93e8-140d625f41bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:50.087935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b6d91-f079-454a-93e8-140d625f41bc None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:50.088218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b6d91-f079-454a-93e8-140d625f41bc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:50.088495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b6d91-f079-454a-93e8-140d625f41bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:50.089602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b6d91-f079-454a-93e8-140d625f41bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:50.091075 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b6d91-f079-454a-93e8-140d625f41bc None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:50.092665 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:50.098422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:50.175397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:50.203925 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fcbb3-51fd-4aea-a8fa-797f5e295fa5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:50.237660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc958830-070d-4345-a06b-5c604181a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:50.238273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958830-070d-4345-a06b-5c604181a8d6 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:50.238556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958830-070d-4345-a06b-5c604181a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:50.238829 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958830-070d-4345-a06b-5c604181a8d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:50.239519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc958830-070d-4345-a06b-5c604181a8d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:50.240967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc958830-070d-4345-a06b-5c604181a8d6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:50.270081 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:24:50 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:24:51.783744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22bdc-07b0-46a9-86b8-727faabac3ee None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:51.784285 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22bdc-07b0-46a9-86b8-727faabac3ee None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:51.784369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22bdc-07b0-46a9-86b8-727faabac3ee None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:51.785703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:51.790965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:51.791392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:51.791679 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:51.810582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:51.811896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:51.877153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:52.145464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22bdc-07b0-46a9-86b8-727faabac3ee None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.241984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:52.250629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22bdc-07b0-46a9-86b8-727faabac3ee None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:52.285139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfc75-677a-4f90-8f43-4c9b5bf2fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:52.285761 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfc75-677a-4f90-8f43-4c9b5bf2fe38 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.286038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfc75-677a-4f90-8f43-4c9b5bf2fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.286307 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfc75-677a-4f90-8f43-4c9b5bf2fe38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.296392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bfc75-677a-4f90-8f43-4c9b5bf2fe38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-777bfc75-677a-4f90-8f43-4c9b5bf2fe38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:24:52.301772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:24:52.302820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:24:52.303900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:24:52.309403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.369913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:52.413091 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc2b8-0005-41f3-b72f-706ca3a92687 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:52.424377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cd2e-44d4-449c-b17f-9ad14f57e273 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.424661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cd2e-44d4-449c-b17f-9ad14f57e273 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.424934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cd2e-44d4-449c-b17f-9ad14f57e273 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.426261 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 26/50] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:24:52.431166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.431452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.431725 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.447080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:52.447715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.447999 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.448277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.448956 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:52.449264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:52.450506 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:52.450641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:52.451731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:52.459344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:52.465020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.524960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 27/52] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:24:52.566950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d2064-e55d-4fa1-86b6-2132816a4283 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:52.586217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:52.600308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:52.600944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.601213 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.601488 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.602618 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:52.604093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:52.605634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:24:52 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:52.611109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.694697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:52.710998 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de4a2f-3837-45fa-9d34-243ea462fa8f None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:52.744289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:52.744913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.745191 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.745459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.746538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:52.748111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:52.750395 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:52.756155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.792618 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.897453 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5874-9936-4c09-9dfd-2194af8c846d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:52.934181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:52.934819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.935124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.935408 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.936542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:52.938822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:52.940434 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:52.945911 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:52.959909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7026-c0b2-4e31-b2a1-79aa3ca98d47 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:52.966930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:52.994839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:52.995479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:52.995766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:52.996046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:52.996766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.domain.id=default, user.id=408c4550159c4ddc8a18898824740b43) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:24:52.997075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:52.998538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bac3a3-ef65-4399-b8e1-a23733cb4721 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:53.006922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1322 bytes} [Fri Sep 9 04:24:52 2022] GET /identity/v3/role_assignments?user.id=408c4550159c4ddc8a18898824740b43&scope.domain.id=default&role.id=d4776e2384644965a0ae59d37530328f => generated 530 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:24:53.049573 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126b7ac-c2d3-43ed-a4bd-d12eaeaabb7c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:53.086420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41a33a-48e0-4424-98b5-980718e73f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:53.087055 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a33a-48e0-4424-98b5-980718e73f19 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:53.087370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a33a-48e0-4424-98b5-980718e73f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:53.087646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a33a-48e0-4424-98b5-980718e73f19 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:53.088322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41a33a-48e0-4424-98b5-980718e73f19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:53.089835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41a33a-48e0-4424-98b5-980718e73f19 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:53.119625 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Fri Sep 9 04:24:52 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:24:55.302442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b697be-d790-4e6b-b0cb-f2c4c014eecc None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:55.302920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b697be-d790-4e6b-b0cb-f2c4c014eecc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:55.303001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b697be-d790-4e6b-b0cb-f2c4c014eecc None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:55.304358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:55.310345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:55.310769 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:55.310898 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:55.331981 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:55.333169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:55.401145 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:55.678815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b697be-d790-4e6b-b0cb-f2c4c014eecc None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:55.733362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:55.782899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b697be-d790-4e6b-b0cb-f2c4c014eecc None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:55.820424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839f463-6299-4384-9fc2-dc7376f209de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:55.821056 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f463-6299-4384-9fc2-dc7376f209de None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:55.821340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f463-6299-4384-9fc2-dc7376f209de None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:55.821617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f463-6299-4384-9fc2-dc7376f209de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:55.822736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839f463-6299-4384-9fc2-dc7376f209de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:55.824221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839f463-6299-4384-9fc2-dc7376f209de None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:55.825789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:24:55.831462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:55.833651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:55.972665 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a194c-fe74-493e-aa3c-98c99df3eeea None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:24:56.008350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6aba2-55e3-4085-beda-8c2dd1e039ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:24:56.008960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6aba2-55e3-4085-beda-8c2dd1e039ec None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:56.009246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6aba2-55e3-4085-beda-8c2dd1e039ec None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:56.009522 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6aba2-55e3-4085-beda-8c2dd1e039ec None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:56.010179 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6aba2-55e3-4085-beda-8c2dd1e039ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:24:56.011680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6aba2-55e3-4085-beda-8c2dd1e039ec None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:24:56.043137 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:24:55 2022] POST /identity/v3/users => generated 275 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:24:59.522484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616343a-5c99-42cf-b53e-3611afc4a713 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.523456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616343a-5c99-42cf-b53e-3611afc4a713 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.523986 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616343a-5c99-42cf-b53e-3611afc4a713 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.525532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:59.531772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba55d25-8806-41b8-912b-3eb224093e32 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.532623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba55d25-8806-41b8-912b-3eb224093e32 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.533097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba55d25-8806-41b8-912b-3eb224093e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.560092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-0ba55d25-8806-41b8-912b-3eb224093e32 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:59.561815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0ba55d25-8806-41b8-912b-3eb224093e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:59.582669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5d55-8705-44c9-b4cf-c17a00cd749c None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.583338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5d55-8705-44c9-b4cf-c17a00cd749c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.583816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5d55-8705-44c9-b4cf-c17a00cd749c None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.585397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:24:59.591156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06209a03-55c9-40c6-ad6e-6da13dd7d699 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.591841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06209a03-55c9-40c6-ad6e-6da13dd7d699 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.592436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06209a03-55c9-40c6-ad6e-6da13dd7d699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.621229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-06209a03-55c9-40c6-ad6e-6da13dd7d699 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:59.626073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-06209a03-55c9-40c6-ad6e-6da13dd7d699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:59.644254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:24:59.662741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 33/64] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:59.664978 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf898ae-4fce-4372-ba7f-a19089a4740b None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.665470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf898ae-4fce-4372-ba7f-a19089a4740b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.666000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf898ae-4fce-4372-ba7f-a19089a4740b None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.667520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 34/65] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:59.679879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.680447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.680945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.711658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 32/66] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:59.720118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:59.721629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:24:59.821592 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 35/67] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:24:59.932889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585edeb9-5e37-4cf8-9e10-8c6e6e8279af None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.933256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585edeb9-5e37-4cf8-9e10-8c6e6e8279af None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.933496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585edeb9-5e37-4cf8-9e10-8c6e6e8279af None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.934739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:24:59.935611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 33/68] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:24:59.941490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:24:59.941781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:24:59.942012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:24:59.966149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:24:59.967358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:00.052516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.077088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0d7da-8763-4bdb-845e-8f394e671a69 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.083160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:00.083160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.096184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.115163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea585b-775e-4ffa-971b-09dd5af9b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.116133 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea585b-775e-4ffa-971b-09dd5af9b433 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.116426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea585b-775e-4ffa-971b-09dd5af9b433 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.116965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea585b-775e-4ffa-971b-09dd5af9b433 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.130226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea585b-775e-4ffa-971b-09dd5af9b433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-fbea585b-775e-4ffa-971b-09dd5af9b433 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:00.136457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:00.137460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:00.138361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:00.139254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba764a3-935e-4baa-a54d-aef44539c64e None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.139493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba764a3-935e-4baa-a54d-aef44539c64e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.140249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba764a3-935e-4baa-a54d-aef44539c64e None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.141863 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 37/71] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:00.147130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba764a3-935e-4baa-a54d-aef44539c64e None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.203834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a336e2-e1d4-4662-bbe1-24e5c42dd535 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.246150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45c43e-02cc-4ace-abc8-cd8a24f2b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.246877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c43e-02cc-4ace-abc8-cd8a24f2b5ce None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.247261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c43e-02cc-4ace-abc8-cd8a24f2b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.247636 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c43e-02cc-4ace-abc8-cd8a24f2b5ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.257510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba764a3-935e-4baa-a54d-aef44539c64e None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.258501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45c43e-02cc-4ace-abc8-cd8a24f2b5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-de45c43e-02cc-4ace-abc8-cd8a24f2b5ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:00.263434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:00.264283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:00.265532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 35/72] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:00.267394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.267499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.267741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.285729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:00.286924 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:00.298477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.299118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.299652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.299652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.300327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:00.300656 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:00.302030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:00.310434 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 38/73] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:00.311251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.329555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.364583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.364937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 36/74] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:00.365799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.439416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e1683-3f02-49e0-bb47-e93ba88d9b15 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.469395 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97844814-cb60-4066-a46e-d6e60ef51448 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.475146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.475895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.476470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.476588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.487742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:00.493498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:00.494329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:00.495069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 39/75] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:00.496640 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.505528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.506142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.506423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.506698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.507484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:00.507787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:00.509180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:00.518396 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 37/76] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:00.519218 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.556016 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.607693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.610923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6aa3-5644-4cf6-87a7-27fb43ab1e05 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.633588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffade0-de5f-4c4f-8151-0b46499630b2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.646209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.646849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.647153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.647432 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.660922 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:00.662402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:00.664041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 40/77] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:00.664799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.673392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.674032 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.674317 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.674599 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.675739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:00.677190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:00.678815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 38/78] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:00.683229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.763926 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc02ea-fd2b-424a-b7fa-9e24e452c6f7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.776401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.779579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9236a-c809-4c3c-a9b5-f2e9e7bffe99 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.798653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.799295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.799582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.799857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.800517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:00.800821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:00.802201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:00.810034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 41/79] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:00.810807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.813764 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.814401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.814684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.814962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.816398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:00.817839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:00.819460 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 39/80] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:00.820197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.837315 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:00.917449 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc591cbd-db28-45f7-b0d1-d3ed241ddc3c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.919781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093f7d-f3a9-4825-add3-a5c00145facf None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:00.953079 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.953708 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.953990 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.954259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.955020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:00.955650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:00.955940 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:00.956211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:00.964102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:00.970074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:00.970952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:00.971811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 42/81] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:00.972444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:00.992517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.026971 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.028481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.052852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.071452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b1ba-b9cd-42e5-9589-3ed2ca526413 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.105741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.106353 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.106635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.106916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.107599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.109626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.130549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 40/82] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:01.147421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 43/83] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:00 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:01.147650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.147742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.233976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.263952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87df2-686a-4437-8de8-579aa05fea2a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.273242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ac493-0674-49c6-b39a-38fb8a82220e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.304887 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.305510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.305797 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.306078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.310575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.313301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.314535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.314535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.314535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.315794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.317248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.318819 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:01.320430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.386705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.388563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.446475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090230-4626-41e8-8697-65a992c09b96 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.487554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.488196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.488635 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.488752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.489524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:01.489817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.492457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.496736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.507439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 42/85] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:01.508196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.514195 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 44/86] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:01.515484 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.553632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.627456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91650b-85e2-4abb-b1c3-fa874e384b54 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.661194 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690f1ae-35df-4761-a832-3d484d9c4279 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.666308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.667024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.667456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.667822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.709652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.710534 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.710956 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.711392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.713293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.715400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.718306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 43/87] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:01.719504 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.750747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.752004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.788909 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.812261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:01.853623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95d34-93cf-46a4-86fb-5fbd2c9f7ab8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:01.870684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 45/88] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:01.871768 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.896451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:01.897088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:01.897369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:01.897643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:01.898888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:01.900406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:01.902087 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 44/89] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:01.903121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:01.981429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb25f-5e81-41a6-ab55-8c9053af2648 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.016007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34090f6-2ffe-4134-bb06-9ec45d6befc9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.019309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.020135 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.020557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.020967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.022240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.023869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.025663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 46/90] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:02.026563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:02.030938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:02.055891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.056509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.056946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.057197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.058147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=42675cfd2cb948e594dd6524b6c13979) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:02.058343 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.060102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.062699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:02.068202 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:01 2022] GET /identity/v3/role_assignments?user.id=42675cfd2cb948e594dd6524b6c13979&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:02.070139 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:02.141874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb38d20-024e-4190-8aa4-bea3be056a90 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.179255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.180370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.180848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.181331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.182644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.184710 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.187245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:02 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:02.188538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:02.226175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654dec3-ea3e-4802-94aa-bede1c59c8db None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.279633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:02.299412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.299988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.300268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.300536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.318640 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290e308-a088-4c39-b33b-10e530839d09 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.393183 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.394192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.399495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.399791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.400575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=408c4550159c4ddc8a18898824740b43) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:02.400899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.402401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.409067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 48/93] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:02 2022] GET /identity/v3/role_assignments?user.id=408c4550159c4ddc8a18898824740b43&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:02.409873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:02.426228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:02.429831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.431458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.580763 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf00bb-bbc7-465a-a301-eeba731a2ec1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.599286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 46/94] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:02.604485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:02.654735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.655773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.656181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.656519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.657272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] RBAC: Adding query filter params (role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=42675cfd2cb948e594dd6524b6c13979) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:02.657582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.659233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.671617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:02.679507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 49/95] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:02 2022] GET /identity/v3/role_assignments?user.id=42675cfd2cb948e594dd6524b6c13979&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:02.716960 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb644cc-5945-49a9-923c-3d69c6f43a55 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:02.721002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:02.757122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68492a-0863-4f36-a6c3-811c37d39df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:02.757757 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68492a-0863-4f36-a6c3-811c37d39df3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:02.758039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68492a-0863-4f36-a6c3-811c37d39df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:02.758312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68492a-0863-4f36-a6c3-811c37d39df3 None admin] PATH_INFO: `/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:02.759479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68492a-0863-4f36-a6c3-811c37d39df3 None admin] RBAC: Authorizing `identity:get_project(project_id=c9aee0cbf8174f84be12b2ceb9f77a68)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:02.760921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68492a-0863-4f36-a6c3-811c37d39df3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:02.762548 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 47/96] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:02 2022] GET /identity/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:02.769181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:03.101212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8100df7-d156-4eb5-8751-d2ab420a64be None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:03.191888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:03.192492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:03.192781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:03.193056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:03.193807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=c9aee0cbf8174f84be12b2ceb9f77a68, user.id=42675cfd2cb948e594dd6524b6c13979) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:03.194122 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:03.195628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9916c9-6cc6-4a8c-aac5-7ac9611de729 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:03.201865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 50/97] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:02 2022] GET /identity/v3/role_assignments?user.id=42675cfd2cb948e594dd6524b6c13979&scope.project.id=c9aee0cbf8174f84be12b2ceb9f77a68&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 259 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:04.060204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851789e-1a29-4ca3-a1cd-0413ee8ae15f None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:04.060702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851789e-1a29-4ca3-a1cd-0413ee8ae15f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:04.060804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851789e-1a29-4ca3-a1cd-0413ee8ae15f None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:04.062576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 48/98] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:04.068012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:04.068405 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:04.068585 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:04.089354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c545f-7e2d-4f8b-8289-d5f31316d56f None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:04.089669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c545f-7e2d-4f8b-8289-d5f31316d56f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:04.089911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c545f-7e2d-4f8b-8289-d5f31316d56f None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:04.091297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 49/99] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:04.093304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:04.094829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:04.097660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:04.098018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:04.098363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:04.116521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:04.117811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:04.190826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 50/100] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:04.195136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:04.216318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:04.595791 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:04.699659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:04.706256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0ca3-c1dc-469f-8da9-5ee53388e6d3 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:04.741721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:04.742361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:04.742640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:04.742910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:04.753512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:04.757411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:04.758521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:04.759613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:04.760367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 51/102] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:04.766146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:04.870007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc506261-d7fb-45d4-b6ed-f9bcb3da828e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:04.910133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58687a-31db-4089-9189-de65271adb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:04.910768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58687a-31db-4089-9189-de65271adb00 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:04.911117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58687a-31db-4089-9189-de65271adb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:04.911401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58687a-31db-4089-9189-de65271adb00 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:04.912120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58687a-31db-4089-9189-de65271adb00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:04.912425 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58687a-31db-4089-9189-de65271adb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:04.914957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58687a-31db-4089-9189-de65271adb00 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:04.923823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 52/103] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:04.930633 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58687a-31db-4089-9189-de65271adb00 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:04.950799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:04.961751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bef1a-19f4-4f42-99d6-a8c9f36b1d94 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:05.025335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:05.026360 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.026930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.027413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.028773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:05.030980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:05.033164 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 52/104] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:05.038423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58687a-31db-4089-9189-de65271adb00 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:05.040635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:05.093582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:05.094254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.094495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.094750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] PATH_INFO: `/v3/users/60ed23fb45d54cdd8b8c80f9254a4a5e` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.141157 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] RBAC: Authorizing `identity:get_user(user_id=60ed23fb45d54cdd8b8c80f9254a4a5e)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:05.142550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:05.145541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 53/105] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:04 2022] GET /identity/v3/users/60ed23fb45d54cdd8b8c80f9254a4a5e => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:05.157319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:05.191458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:05.283742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c56ac-e14c-42f3-96cb-11bc14c171e8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:05.318205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:05.348202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:05.348867 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.349147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.349416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.350749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:05.352222 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:05.370467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618cc78-b7e7-4a2f-af4d-74303d63571e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:05.395748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 53/106] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:25:05 2022] POST /identity/v3/projects => generated 302 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:05.408893 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:05.409513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.409852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.410138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.486405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:05.487934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:05.570107 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:05.596093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 54/107] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:05.602735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:05.761309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3d08e-86be-4562-9035-657c511e169a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:05.784255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:05.814973 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b1b1b-8bd7-4905-90b6-6b3b1fe1f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:05.815639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b1b1b-8bd7-4905-90b6-6b3b1fe1f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.815920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b1b1b-8bd7-4905-90b6-6b3b1fe1f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.816197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b1b1b-8bd7-4905-90b6-6b3b1fe1f3a0 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.817377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b1b1b-8bd7-4905-90b6-6b3b1fe1f3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:05.818835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b1b1b-8bd7-4905-90b6-6b3b1fe1f3a0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:05.820861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 54/108] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:05 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:05.827250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:05.958035 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b236c1-bc92-45e4-9ed2-29b1ab7a5a2f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:05.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc8ca8-5856-4b90-b234-1617f939d130 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.979930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc8ca8-5856-4b90-b234-1617f939d130 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.980471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc8ca8-5856-4b90-b234-1617f939d130 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.982018 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 55/109] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:05.988416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c333f-6285-4a19-967a-5a1fc87e1093 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.988982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c333f-6285-4a19-967a-5a1fc87e1093 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.989456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c333f-6285-4a19-967a-5a1fc87e1093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:05.994839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:05.995914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:05.995914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:05.996096 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.003134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] RBAC: Adding query filter params (role.id=1d3b687e66b840ed8e51b39e1a59ed7b, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=60ed23fb45d54cdd8b8c80f9254a4a5e) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:06.003134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:06.003134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9849-d0b9-48ce-a3a6-954c2588d771 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:06.005669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 55/110] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:05 2022] GET /identity/v3/role_assignments?user.id=60ed23fb45d54cdd8b8c80f9254a4a5e&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=1d3b687e66b840ed8e51b39e1a59ed7b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:06.020832 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-651c333f-6285-4a19-967a-5a1fc87e1093 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:06.022424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-651c333f-6285-4a19-967a-5a1fc87e1093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:06.130651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 56/111] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:06.150894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b3e5-62fe-4929-aade-62838f1aede1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.151887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b3e5-62fe-4929-aade-62838f1aede1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.152373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b3e5-62fe-4929-aade-62838f1aede1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.154167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 56/112] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:06.160791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0134-7b7c-46ea-a296-1ff088fed754 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.161066 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0134-7b7c-46ea-a296-1ff088fed754 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.161403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0134-7b7c-46ea-a296-1ff088fed754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.186032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-5f3f0134-7b7c-46ea-a296-1ff088fed754 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:06.187685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-5f3f0134-7b7c-46ea-a296-1ff088fed754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:06.299799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 57/113] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:06.301894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794cbdc-6945-443a-852e-730574a82d33 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.302186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794cbdc-6945-443a-852e-730574a82d33 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.302464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794cbdc-6945-443a-852e-730574a82d33 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.308304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 57/114] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:06.326556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930b12-cf04-42e1-99f5-fcd4392dc6dd None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.327249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930b12-cf04-42e1-99f5-fcd4392dc6dd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.327745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930b12-cf04-42e1-99f5-fcd4392dc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.357663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-77930b12-cf04-42e1-99f5-fcd4392dc6dd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:06.359834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-77930b12-cf04-42e1-99f5-fcd4392dc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:06.410411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:06.453410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 58/115] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:06.599775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794cbdc-6945-443a-852e-730574a82d33 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:06.638923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e2e94-3b89-4ff5-bae2-ef41c10ba314 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.639250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e2e94-3b89-4ff5-bae2-ef41c10ba314 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.640285 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e2e94-3b89-4ff5-bae2-ef41c10ba314 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.642033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 59/116] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:06.655483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.656072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.656525 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:06.657715 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.684252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:06.685760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:06.748897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794cbdc-6945-443a-852e-730574a82d33 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:06.821900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 60/117] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 04:25:06.831805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:06.832466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:06.832752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:06.833032 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:06.847872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:06.849424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:06.854919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:06.855967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:06.856864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:06.859242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 58/118] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:06.868236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.043548 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.044093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398d0b-4e0b-4601-aa51-e69aa47e797b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.046165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.048161 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61a7ad-2364-40fd-a55f-5394b7085a9b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.087521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.088475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.088679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.089156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.089317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.089741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.089843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.090040 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.090869 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:07.091393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.093614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.100932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:07.102590 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 59/119] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:07.106198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:07.107058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:07.107813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:07.109914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.111409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 61/120] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:07.116059 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.240243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2eb36-e186-42bb-8bf5-cd2849e7c42e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.278480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.279431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.279883 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.280379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.281678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.283345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.285073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:07.286113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.293128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49f2e-5448-4b9c-91a8-1108f3b751aa None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.323139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.335437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.336381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.336853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.337739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.350783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:07.358015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:07.359119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:07.359877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:07.360448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:07.362347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.395523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.418136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b88991-8abc-405b-a27b-c4ed4adb000a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.466681 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.468244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.468737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.469219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.470596 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:07.471163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.473417 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.482607 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debf3c3-bf67-43a0-a36a-7eab300128f5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.485251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:07.486341 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.533106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.533939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.534145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.535233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.546365 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:07.551464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:07.552289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:07.553038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:07.553657 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.617821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.631414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c88768-ffa9-4655-9416-9128097a4062 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.657253 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.679740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c1929-ad19-45ea-b2c7-18b74b9d6c04 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.683216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.684271 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.684692 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.685109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.686562 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.688736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.691387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:07.692423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.725575 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.726413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.727058 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.727205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.727848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:07.728150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.729753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.739810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 62/126] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:07.744335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.809103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc957-b3b0-45a1-9f2c-c4f73c4bf320 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.843566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.844499 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.844499 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.844744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.845876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.847376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.849162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 65/127] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:07.849671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.875396 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78757-9797-43d8-9c2c-b2bdd7911807 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:07.879646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.922476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:07.923119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:07.923398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:07.923685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:07.924397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:07.924643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:07.926057 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:07.934842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 63/128] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:07.935710 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:07.945150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:07.982830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d19711-e6ae-4fd3-ae15-226be77facdf None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.030098 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.030742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.031031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.031352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/42675cfd2cb948e594dd6524b6c13979/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.033597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0efab51db14b88959d3315ce33c6fa, user_id=42675cfd2cb948e594dd6524b6c13979, role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.035064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.052862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 66/129] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:07 2022] PUT /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/42675cfd2cb948e594dd6524b6c13979/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:08.055750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67da3-93d4-42e4-b497-97c196efb2c3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.059468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.126467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.129351 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.129955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.130467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.133014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.136415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.147529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 64/130] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:07 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:08.148307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.241652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:08.271328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12aa8-7c33-4f26-b00d-4bec89196724 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.277507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:08.308172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8cb1-c62b-40d5-90ce-f064143e3bcc None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.335845 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.336482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.336766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.337043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.338970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.340587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.342180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 65/131] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:08 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:08.343784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.357938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.359447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.359903 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.360403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.362538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.364370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.366329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 67/132] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:08 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:08.367488 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.490168 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411e57d-88e7-4e7a-a342-64bade47d025 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.526659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.527324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.527612 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.527994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.529228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.539130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.539130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 66/133] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:08 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:08.539130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.541243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56d291-c133-4e60-81e0-e8d526e37a27 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.554232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:08.592888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.593790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.594077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.594833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] PATH_INFO: `/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.596307 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] RBAC: Authorizing `identity:get_project(project_id=c9aee0cbf8174f84be12b2ceb9f77a68)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.598443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.600497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 68/134] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:08 2022] GET /identity/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:08.601930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.630460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:08.657736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c635f3-b83e-4a8f-96f5-cb8dfb063ef4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.694419 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9c8d2-1b0f-412c-8a31-b6b48ea847ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.695241 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c8d2-1b0f-412c-8a31-b6b48ea847ad None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.695533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c8d2-1b0f-412c-8a31-b6b48ea847ad None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.695811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c8d2-1b0f-412c-8a31-b6b48ea847ad None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/42675cfd2cb948e594dd6524b6c13979/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.697739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9c8d2-1b0f-412c-8a31-b6b48ea847ad None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0efab51db14b88959d3315ce33c6fa, user_id=42675cfd2cb948e594dd6524b6c13979, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.699262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9c8d2-1b0f-412c-8a31-b6b48ea847ad None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.711338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8fd64-fecc-4e96-913f-ca84b5da3397 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.715423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:08 2022] PUT /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/42675cfd2cb948e594dd6524b6c13979/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:08.716913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89379e5-8407-447e-a567-5ba411a248ca None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.717333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89379e5-8407-447e-a567-5ba411a248ca None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.717789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89379e5-8407-447e-a567-5ba411a248ca None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.719823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 68/136] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:08.720749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89379e5-8407-447e-a567-5ba411a248ca None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:08.758452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa5632-a1d2-46e7-ad8f-f634fb872d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.759061 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa5632-a1d2-46e7-ad8f-f634fb872d00 None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.759474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa5632-a1d2-46e7-ad8f-f634fb872d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.759770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa5632-a1d2-46e7-ad8f-f634fb872d00 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/408c4550159c4ddc8a18898824740b43/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.761779 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa5632-a1d2-46e7-ad8f-f634fb872d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0efab51db14b88959d3315ce33c6fa, user_id=408c4550159c4ddc8a18898824740b43, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.763685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa5632-a1d2-46e7-ad8f-f634fb872d00 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:08.786180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:08 2022] PUT /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/408c4550159c4ddc8a18898824740b43/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:08.786180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be583cd-e7d7-418b-bb98-187f4f9d164d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.786180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be583cd-e7d7-418b-bb98-187f4f9d164d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.786180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be583cd-e7d7-418b-bb98-187f4f9d164d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.786180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 70/138] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:08.787708 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9b4a-19f9-40ae-a00c-49f35bc7188c None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.787708 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9b4a-19f9-40ae-a00c-49f35bc7188c None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.787943 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee9b4a-19f9-40ae-a00c-49f35bc7188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.810213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-8fee9b4a-19f9-40ae-a00c-49f35bc7188c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:08.814471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-8fee9b4a-19f9-40ae-a00c-49f35bc7188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:08.845462 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:08.922988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89379e5-8407-447e-a567-5ba411a248ca None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:08.953738 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 71/139] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:08.955675 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.955968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.964403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.992207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:08.993042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:08.993423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:08.993797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] PATH_INFO: `/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68/users/42675cfd2cb948e594dd6524b6c13979/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:08.996064 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] RBAC: Authorizing `identity:create_grant(project_id=c9aee0cbf8174f84be12b2ceb9f77a68, user_id=42675cfd2cb948e594dd6524b6c13979, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:08.996240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:08.997444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:08.997826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:09.013314 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:09.018063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 69/140] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:08 2022] PUT /identity/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68/users/42675cfd2cb948e594dd6524b6c13979/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:09.101674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 72/141] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:09.356264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:09.484250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83ee8-b6a5-4fe0-8874-35ece0183eee None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:09.511223 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:09.532805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:09.540301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:09.542622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:09.543169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:09.543721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:09.555723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:09.562777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:09.563646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:09.564379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:09.567340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 70/142] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:09.574882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:09.692747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a00d1-f1e9-4c62-a8b6-65d830bcbb90 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:09.733595 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:09.734419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:09.734672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:09.735276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:09.739573 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:09.741033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:09.743137 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 73/143] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:09.749328 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:09.766972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:09.769514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f2556-5368-4ab0-ab75-0f35bb5656d5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:09.844921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:09.845900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:09.846381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:09.846899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:09.847803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:09.848311 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:09.849898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:09.868871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 71/144] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:09.875948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:09.903715 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fd1e1-5bef-449c-81db-3d8847660746 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:09.986181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:09.987155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:09.987639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:09.988129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:09.988986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:09.990636 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:09.993457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:10.024369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 74/145] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:09 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:25:10.082401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd606601-3a7d-489d-8d12-4b9c12628c3b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:10.133159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:10.133807 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:10.134144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:10.134422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] PATH_INFO: `/v3/users/60ed23fb45d54cdd8b8c80f9254a4a5e` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:10.135603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] RBAC: Authorizing `identity:get_user(user_id=60ed23fb45d54cdd8b8c80f9254a4a5e)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:10.137103 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:10.139037 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 72/146] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:09 2022] GET /identity/v3/users/60ed23fb45d54cdd8b8c80f9254a4a5e => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:10.144372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:10.258106 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:10.309615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e777e9-4233-4bec-b1e3-a0d0d8ed88d7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:10.360275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74094c-5dee-4be0-9956-98aaf3c9b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:10.360917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74094c-5dee-4be0-9956-98aaf3c9b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:10.361195 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74094c-5dee-4be0-9956-98aaf3c9b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:10.361469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74094c-5dee-4be0-9956-98aaf3c9b0d0 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:10.362596 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74094c-5dee-4be0-9956-98aaf3c9b0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:10.364101 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74094c-5dee-4be0-9956-98aaf3c9b0d0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:10.365754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 75/147] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:10 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:10.371491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:10.502237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b939a3-d8e3-4eb5-ad7f-7f06b5f61066 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:10.525783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:10.540840 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9ab3-453a-454a-b3d1-4f8ff2af1b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:10.541505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9ab3-453a-454a-b3d1-4f8ff2af1b24 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:10.541789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9ab3-453a-454a-b3d1-4f8ff2af1b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:10.542074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9ab3-453a-454a-b3d1-4f8ff2af1b24 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/60ed23fb45d54cdd8b8c80f9254a4a5e/roles/1d3b687e66b840ed8e51b39e1a59ed7b` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:10.544340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd9ab3-453a-454a-b3d1-4f8ff2af1b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0efab51db14b88959d3315ce33c6fa, user_id=60ed23fb45d54cdd8b8c80f9254a4a5e, role_id=1d3b687e66b840ed8e51b39e1a59ed7b)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:10.546254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd9ab3-453a-454a-b3d1-4f8ff2af1b24 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:10.562361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 73/148] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:10 2022] PUT /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa/users/60ed23fb45d54cdd8b8c80f9254a4a5e/roles/1d3b687e66b840ed8e51b39e1a59ed7b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:11.045583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccdc51-70ad-4b5a-b301-8c289e136e6f None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:11.046596 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccdc51-70ad-4b5a-b301-8c289e136e6f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:11.047127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccdc51-70ad-4b5a-b301-8c289e136e6f None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:11.048677 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 76/149] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:11.054428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:11.054983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:11.055478 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:11.078026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:11.079577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:11.168447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 74/150] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:11.721134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccdc51-70ad-4b5a-b301-8c289e136e6f None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:11.864910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccdc51-70ad-4b5a-b301-8c289e136e6f None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:11.906914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:11.907938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:11.908439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:11.908913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:11.912108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:11.923847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:11.929237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:11.930064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:11.930869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:11.933130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 77/151] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:11.940800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:12.050919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8453103-0a19-4695-b67d-aa0f9730780e None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:12.064154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:12.090531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:12.091546 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.092040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.093082 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.094168 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:12.094699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:12.096415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab04027-798e-48bb-b430-05903da9448a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:12.108518 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 75/152] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:12.114620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:12.220838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5acea-ac5d-40e3-82ed-31026387e91f None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.221471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5acea-ac5d-40e3-82ed-31026387e91f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.221952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5acea-ac5d-40e3-82ed-31026387e91f None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.223597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 76/153] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:12.230100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49fd7f-1efe-433f-993d-0d6b07059dfa None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.230660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49fd7f-1efe-433f-993d-0d6b07059dfa None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.231178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49fd7f-1efe-433f-993d-0d6b07059dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.265070 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-6d49fd7f-1efe-433f-993d-0d6b07059dfa None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:12.271299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6d49fd7f-1efe-433f-993d-0d6b07059dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:12.280076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8976-c0fe-4d24-b2b1-8567bf598981 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:12.349300 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:12.350274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.350756 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.351257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.352722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:12.354475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:12.363732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 78/154] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:12 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:12.376606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:12.415547 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 77/155] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:12.460278 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:12.504578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b3089-65f0-44fb-ad6d-4fff9c2e24fe None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.505174 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b3089-65f0-44fb-ad6d-4fff9c2e24fe None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.505669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b3089-65f0-44fb-ad6d-4fff9c2e24fe None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.507862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 78/156] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:12.517249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0fcc0-82bf-46b1-826b-899568c61040 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:12.525643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.526254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.526739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.558555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:12.560374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:12.571201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:12.571834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:12.572109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:12.572377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:12.665713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 79/157] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:12.682609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:12.684375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:12.776800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:12.831634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:12.837684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:12.881191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:12.970102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa251-f400-4a4e-b9d7-b994bd38fe46 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:13.011393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:13.012473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.012962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.013444 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.015515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:13.017411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:13.019494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 80/159] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:12 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:13.025656 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:13.167495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:13.182177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e437d0d-6d23-4276-ace0-41178c6f9c76 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:13.247346 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:13.247961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.248234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.248537 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.250179 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] RBAC: Adding query filter params (role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=42675cfd2cb948e594dd6524b6c13979) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:13.250660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:13.252274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:13.258721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 80/160] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/role_assignments?user.id=42675cfd2cb948e594dd6524b6c13979&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:13.259545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:13.339011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:13.377301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:13.385965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fc64-32af-4894-9837-75b6357fdd3e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:13.447821 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcaaf8-0141-495d-8840-6c41e467a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:13.448476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcaaf8-0141-495d-8840-6c41e467a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.448757 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcaaf8-0141-495d-8840-6c41e467a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.449027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcaaf8-0141-495d-8840-6c41e467a8f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.468356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcaaf8-0141-495d-8840-6c41e467a8f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-11dcaaf8-0141-495d-8840-6c41e467a8f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:13.473467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:13.474411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:13.475671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 81/161] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:13.476438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436f53-a80b-4b40-a5b8-6612ce30a277 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.476509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436f53-a80b-4b40-a5b8-6612ce30a277 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.476865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436f53-a80b-4b40-a5b8-6612ce30a277 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.478274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 82/162] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:13.488689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.488867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.489145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.509301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541bb6-3bff-4dac-a022-65cd5ea865ef None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:13.516165 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:13.517376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:13.579109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:13.580903 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.581189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.581463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.595238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:13.600680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:13.601557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 81/163] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:13.602705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:13.622797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 83/164] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:13.625338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:13.764703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:13.784449 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9403b92-77ee-4f97-819a-c1c72819e230 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:13.798912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:13.816804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292e729-bd2d-4351-bb0c-6704cf8ccedf None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:13.853212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:13.855131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.855472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.855741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.856644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:13.856948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:13.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:13.876901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 82/165] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:13.880719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:13.881331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:13.881651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:13.881923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:13.882667 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:13.883851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:13.885508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:13.886893 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:13.905630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 84/166] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:13.911269 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:14.074382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcb6f3-97db-4532-bdad-0bc5baefe539 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:14.097348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78bd0e-8e46-46af-8665-1982b4bbb782 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:14.145354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:14.146010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.146293 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.146571 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.152146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:14.153669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:14.155448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 83/167] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:14.161600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:14.175528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:14.176328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.176561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.176839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] PATH_INFO: `/v3/users/408c4550159c4ddc8a18898824740b43` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.178023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] RBAC: Authorizing `identity:get_user(user_id=408c4550159c4ddc8a18898824740b43)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:14.179709 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:14.181517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 85/168] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:13 2022] GET /identity/v3/users/408c4550159c4ddc8a18898824740b43 => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:14.188073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:14.204475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:14.226364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:14.356314 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e1c59-6a53-47d5-81c3-913f5237edb2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:14.387686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837bd0f-5677-4f26-9b40-6c96ca172d1b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:14.416273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:14.417995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.419781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.420287 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.457092 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0c60a-1144-471d-a797-3f65210f4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:14.458105 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c60a-1144-471d-a797-3f65210f4389 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.458806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c60a-1144-471d-a797-3f65210f4389 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.460222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c60a-1144-471d-a797-3f65210f4389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.559802 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:14.562961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:14.587678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0c60a-1144-471d-a797-3f65210f4389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:14.590026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0c60a-1144-471d-a797-3f65210f4389 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:14.597068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:14.615442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:14.703742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 84/169] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:14.703742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:14.718015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 86/170] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:14.719638 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1985-7a47-4e12-a508-7898bcd2ccbd None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.720111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1985-7a47-4e12-a508-7898bcd2ccbd None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.720548 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1985-7a47-4e12-a508-7898bcd2ccbd None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.722396 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 87/171] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:14.723923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5c48-00b9-4caf-a8c1-945416a922a1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.724730 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5c48-00b9-4caf-a8c1-945416a922a1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.725197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5c48-00b9-4caf-a8c1-945416a922a1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.727026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 88/172] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:14.727937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5c48-00b9-4caf-a8c1-945416a922a1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:14.824260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec12b-d6f2-4b1b-ae0f-56105e119673 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:14.849104 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:14.851890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5c48-00b9-4caf-a8c1-945416a922a1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:14.871967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:14.873196 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.874197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.874619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.877251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:14.891630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:14.896556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:14.897473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:14.898260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 85/173] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:14.898900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:14.900632 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb0d5-14d0-47cb-8cef-ae168728382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:14.901485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb0d5-14d0-47cb-8cef-ae168728382b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.901951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb0d5-14d0-47cb-8cef-ae168728382b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.902413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb0d5-14d0-47cb-8cef-ae168728382b None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.904003 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb0d5-14d0-47cb-8cef-ae168728382b None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:14.906902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb0d5-14d0-47cb-8cef-ae168728382b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:14.910471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 89/174] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:14 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:14.912230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5fd6-0cf6-4bcb-a856-33d9fa607871 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:14.912715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5fd6-0cf6-4bcb-a856-33d9fa607871 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:14.913195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5fd6-0cf6-4bcb-a856-33d9fa607871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:14.931690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-d36e5fd6-0cf6-4bcb-a856-33d9fa607871 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:14.933184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-d36e5fd6-0cf6-4bcb-a856-33d9fa607871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:15.012921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 90/175] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:15.015674 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.016188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.016687 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.035235 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a72b0-eecb-478f-82d6-f6ff4bf72ff6 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.036448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:15.037836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:15.081482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.082117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.082937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.083259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.084421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:15.086398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:15.091558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 86/176] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:14 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:15.093200 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.137136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 91/177] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:15.138603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.189741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:15.227247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:15.283456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d2056-73ce-4e11-b17b-70235ab2142f None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.293282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35e50f-c4be-49d6-94f7-fe9b3c501a95 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.320904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.322002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.322560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.323052 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.324007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=42675cfd2cb948e594dd6524b6c13979) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:15.324514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:15.326156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:15.333685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 92/178] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/role_assignments?user.id=42675cfd2cb948e594dd6524b6c13979&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:15.340300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.378162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.378938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.379167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.379406 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.380134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:15.380682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:15.381807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:15.404992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 87/179] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:15.410917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.460318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264c7e3-f504-417d-9c04-e60588ba1662 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.483726 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:15.506813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.507944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.508509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.508850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.509681 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=408c4550159c4ddc8a18898824740b43) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:15.510063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:15.512053 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:15.520095 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 93/180] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/role_assignments?user.id=408c4550159c4ddc8a18898824740b43&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:15.526174 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.647673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792d4b-e863-43fb-8eb2-a365cfdd1492 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.669805 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:15.708983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f344f-80b8-4533-ae5a-fef43766bc44 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.738728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.739689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.740178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.740593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] PATH_INFO: `/v3/users/42675cfd2cb948e594dd6524b6c13979` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.742010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] RBAC: Authorizing `identity:get_user(user_id=42675cfd2cb948e594dd6524b6c13979)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:15.743654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:15.745435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 88/181] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/users/42675cfd2cb948e594dd6524b6c13979 => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:15.746361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.764858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98aaa-f107-447c-8c5e-793fcefa9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.765640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98aaa-f107-447c-8c5e-793fcefa9da0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.765996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98aaa-f107-447c-8c5e-793fcefa9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.766341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98aaa-f107-447c-8c5e-793fcefa9da0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.784554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98aaa-f107-447c-8c5e-793fcefa9da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-85a98aaa-f107-447c-8c5e-793fcefa9da0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:15.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:15.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:15.791934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:15.795277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 94/182] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:15.797411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94195698-1f23-423d-aabe-3d6dc23fd94e None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.797983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94195698-1f23-423d-aabe-3d6dc23fd94e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.798416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94195698-1f23-423d-aabe-3d6dc23fd94e None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.799824 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 95/183] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:15.800689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94195698-1f23-423d-aabe-3d6dc23fd94e None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.848164 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:15.892313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb2198-504b-42ce-a324-757f071e2196 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.932587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94195698-1f23-423d-aabe-3d6dc23fd94e None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:15.934552 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6399919-d1d0-4e13-9df1-5603ff8d6c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.935358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399919-d1d0-4e13-9df1-5603ff8d6c6b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.935640 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399919-d1d0-4e13-9df1-5603ff8d6c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.935963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399919-d1d0-4e13-9df1-5603ff8d6c6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.946601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6399919-d1d0-4e13-9df1-5603ff8d6c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b6399919-d1d0-4e13-9df1-5603ff8d6c6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:15.952752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:15.953660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 89/184] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:15.955816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063656-01bc-4d24-8cdf-11f553596c4b None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.956509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063656-01bc-4d24-8cdf-11f553596c4b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.956509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063656-01bc-4d24-8cdf-11f553596c4b None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.957139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 90/185] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:15.957848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063656-01bc-4d24-8cdf-11f553596c4b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:15.969732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:15.970345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:15.970621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:15.970892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:15.995110 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.040267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.041732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.061321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063656-01bc-4d24-8cdf-11f553596c4b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.074791 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.096219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.096828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.097107 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.097387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.098046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:16.098347 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.099786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e4712-c12f-4146-a2ec-3a0551337cf5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.108499 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 91/186] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.109731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9b00-798a-494e-bf52-1ea5420e53e4 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.110024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9b00-798a-494e-bf52-1ea5420e53e4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.110299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9b00-798a-494e-bf52-1ea5420e53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.127793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-540e9b00-798a-494e-bf52-1ea5420e53e4 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:16.129003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-540e9b00-798a-494e-bf52-1ea5420e53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:16.143362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 96/187] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:16.143362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.198906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 92/188] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:16.204997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.204997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.204997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.227820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:16.228828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:16.255661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4df0-13f4-4c66-bfb2-115fe362ac55 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.257418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.292867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.293484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.293927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.294202 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.295234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:16.295875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.297257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.300046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.315121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 93/189] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:16.315121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.322650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 97/190] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.323449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.433659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c723-1c2e-4b6a-8bc1-6d2f1c07b11a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.434381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91d93-5552-4f1f-92d1-877313c041d3 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.470288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.470828 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.471247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.471515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] PATH_INFO: `/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.471614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.472204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.472484 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.472670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] RBAC: Authorizing `identity:get_project(project_id=c9aee0cbf8174f84be12b2ceb9f77a68)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.472775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] PATH_INFO: `/v3/users/60ed23fb45d54cdd8b8c80f9254a4a5e` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.473869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] RBAC: Authorizing `identity:get_user(user_id=60ed23fb45d54cdd8b8c80f9254a4a5e)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.474242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.475359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.476168 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 98/191] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/projects/c9aee0cbf8174f84be12b2ceb9f77a68 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.481329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 94/192] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/users/60ed23fb45d54cdd8b8c80f9254a4a5e => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.481329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.484570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.509639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.553952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.588151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de46e-edcd-42cd-94ed-94ab657203fd None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.590328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620179b-81a0-4b7b-89fe-cea248d2759a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.624423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.624613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.625169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.625326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.625415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.625600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] PATH_INFO: `/v3/users/e0f9ccf92ca74e26a7c62e15358172b4` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.625705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.626691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.628201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.629940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 95/193] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.630507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.638904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] RBAC: Authorizing `identity:get_user(user_id=e0f9ccf92ca74e26a7c62e15358172b4)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.640565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.642188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 99/194] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/users/e0f9ccf92ca74e26a7c62e15358172b4 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.642188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.727343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.734513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417982e-f477-4046-9766-37d91dde3026 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.742289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321a687-1223-40bb-8eb5-25eeac8ca37b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.766511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:16.768836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.769442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.769717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.769991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.770713 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=c9aee0cbf8174f84be12b2ceb9f77a68, user.id=42675cfd2cb948e594dd6524b6c13979) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:16.771014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.772500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.777388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.777989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.778162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 96/195] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/role_assignments?user.id=42675cfd2cb948e594dd6524b6c13979&scope.project.id=c9aee0cbf8174f84be12b2ceb9f77a68&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:16.778290 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.778541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.778930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.856839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:16.859005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:16.892579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a603f16-d5bd-4fee-952a-d49880d7b943 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:16.931530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:16.932618 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:16.933228 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:16.933697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:16.945980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:16.951473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:16.952892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:16.953671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 97/196] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:16.954336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.975879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 100/197] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:16.976739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:16.977165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.007313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.073226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710634-848d-4316-9227-17ac4d893e8c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.090609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0beef-9145-486d-8b7e-325f2147c2e8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.106323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.106923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.107240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.107517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.108301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.109749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.125305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.125877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.126341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.126622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.130957 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 98/198] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:16 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:17.131816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.216531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.219641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.223788 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.253118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063cb46-ebb5-47f3-9e2b-417d400e8ba9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.253691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.295564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.296407 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.296773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.297090 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.297733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:17.298036 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.299482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.309223 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 99/199] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:17.311777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.344356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 101/200] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:17.345045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.449001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42517c8-ace9-42f7-9e7f-bd61d22eb8bd None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.475856 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c04b-37b2-4af1-b97c-86b9f06002ad None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.489886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.490636 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.490982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.491287 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.492598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.494050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.495725 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:17.496571 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.502123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.515548 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.522111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.522749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.523027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.523362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] PATH_INFO: `/v3/users/e0f9ccf92ca74e26a7c62e15358172b4` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.524511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f9ccf92ca74e26a7c62e15358172b4)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.525977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.527602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/users/e0f9ccf92ca74e26a7c62e15358172b4 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:17.528441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.624505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6113f-5668-41f8-9d97-4ae1dac5540e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.651680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e14b9-de76-4c16-ae4b-12e137bd7734 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.661424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.662177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.662466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.662743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.664014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.665563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.667481 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 101/203] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:17.668256 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.691851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.692462 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.692741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.693013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.693736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] RBAC: Adding query filter params (role.id=1d3b687e66b840ed8e51b39e1a59ed7b, scope.project.id=8e0efab51db14b88959d3315ce33c6fa, user.id=60ed23fb45d54cdd8b8c80f9254a4a5e) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:17.694040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.697154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.705686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 103/204] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/role_assignments?user.id=60ed23fb45d54cdd8b8c80f9254a4a5e&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=1d3b687e66b840ed8e51b39e1a59ed7b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:17.706912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:17.773993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.805953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:17.837367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d3ce-30a2-4a0e-adc4-bff473db62d5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.857538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b7add-6426-49e6-8bb1-c5186a654bba None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:17.891858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.892409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.892691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.892961 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:17.893715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=e0f9ccf92ca74e26a7c62e15358172b4) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:17.894021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:17.895563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:17.907527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 104/205] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/role_assignments?user.id=e0f9ccf92ca74e26a7c62e15358172b4&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:17.921689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:17.922331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:17.922611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:17.923016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:18.012116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:18.013617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:18.105432 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:18.146199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 102/206] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:18.152193 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:18.275901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746be93-f8a6-4b87-b0b5-9f5c53953741 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:18.297542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:18.312489 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04afcae-dc6d-4e19-a2ed-34693c88b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:18.313330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afcae-dc6d-4e19-a2ed-34693c88b623 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:18.313809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afcae-dc6d-4e19-a2ed-34693c88b623 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:18.314223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afcae-dc6d-4e19-a2ed-34693c88b623 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:18.315555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04afcae-dc6d-4e19-a2ed-34693c88b623 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:18.317133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04afcae-dc6d-4e19-a2ed-34693c88b623 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:18.319267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 105/207] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:18 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:18.328611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:18.433513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af55b93-3602-4202-967b-d4297cbaa808 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:18.473214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:18.473977 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:18.474178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:18.474450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:18.475247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] RBAC: Adding query filter params (role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=e0f9ccf92ca74e26a7c62e15358172b4) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:18.475601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:18.477041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8fa3d-b715-45d9-a225-8d6315043e93 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:18.483409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 103/208] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:18 2022] GET /identity/v3/role_assignments?user.id=e0f9ccf92ca74e26a7c62e15358172b4&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:19.548154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6244c2-8328-4bb3-8fe8-42463c9f71d7 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:19.548655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6244c2-8328-4bb3-8fe8-42463c9f71d7 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:19.548655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6244c2-8328-4bb3-8fe8-42463c9f71d7 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:19.549973 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 106/209] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:19.555273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757917b-2d68-495a-bec1-93a77b56f78d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:19.555681 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757917b-2d68-495a-bec1-93a77b56f78d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:19.555866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757917b-2d68-495a-bec1-93a77b56f78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:19.575952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-2757917b-2d68-495a-bec1-93a77b56f78d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:19.577218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-2757917b-2d68-495a-bec1-93a77b56f78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:19.610007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:19.650285 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 104/210] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:19.694881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895964b6-9917-4e5a-b587-8a284cfa9668 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:19.695536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895964b6-9917-4e5a-b587-8a284cfa9668 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:19.696008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895964b6-9917-4e5a-b587-8a284cfa9668 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:19.697823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 107/211] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:19.703894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:19.704188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:19.704468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:19.724121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:19.725315 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:19.797109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:19.923536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895964b6-9917-4e5a-b587-8a284cfa9668 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.027106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895964b6-9917-4e5a-b587-8a284cfa9668 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:20.066167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:20.066799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.067076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.067377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.072603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.079342 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:20.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:20.087046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:20.087854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:20.095600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.158388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:20.197861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:20.207477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cffc-8d8a-46a9-8295-4bbad37be626 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:20.223518 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692c967-00a2-4ad0-8c46-e7dcfe85bc28 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:20.262224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:20.263042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.263455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.263731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.265668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:20.267857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:20.269875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:20.275125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:20.275474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.275957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.276320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.276684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.277515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:20.277900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:20.279403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744c83e-238b-4afc-be10-6571515d3eca None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:20.289724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:20.296275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba52f5b-05de-42ae-b37f-4844db860f66 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.296570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba52f5b-05de-42ae-b37f-4844db860f66 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.296853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba52f5b-05de-42ae-b37f-4844db860f66 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.298439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 110/216] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:20.299181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba52f5b-05de-42ae-b37f-4844db860f66 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.396481 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbead6d-96b7-4773-b104-b25faafe42c0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:20.414846 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba52f5b-05de-42ae-b37f-4844db860f66 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:20.426438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:20.432767 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdac3d-2bc9-4499-bdb1-6ce83263ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:20.433378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdac3d-2bc9-4499-bdb1-6ce83263ddba None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.433664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdac3d-2bc9-4499-bdb1-6ce83263ddba None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.434172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdac3d-2bc9-4499-bdb1-6ce83263ddba None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.434907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdac3d-2bc9-4499-bdb1-6ce83263ddba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:20.436578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdac3d-2bc9-4499-bdb1-6ce83263ddba None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:20.453723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:20.454309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.454593 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.454859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] PATH_INFO: `/v3/users/31d2a21b98784443be7c74f7ef058d58` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.459979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 107/217] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:20 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:25:20.464519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adefa23-3880-49fd-905b-7d8e99e57e08 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.464817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adefa23-3880-49fd-905b-7d8e99e57e08 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.465073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adefa23-3880-49fd-905b-7d8e99e57e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.475597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] RBAC: Authorizing `identity:get_user(user_id=31d2a21b98784443be7c74f7ef058d58)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:20.477157 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:20.483233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 111/218] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:20 2022] GET /identity/v3/users/31d2a21b98784443be7c74f7ef058d58 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:20.488482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.493846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-7adefa23-3880-49fd-905b-7d8e99e57e08 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:20.495073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7adefa23-3880-49fd-905b-7d8e99e57e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:20.512365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:20.611181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 108/219] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:20.633096 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa702a-be5e-4df2-b607-9d1dbd8c242e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:20.671309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:20.672212 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.672683 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.673092 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.685936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2a71a-7d72-40c3-a087-282ec5563dd3 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.686366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2a71a-7d72-40c3-a087-282ec5563dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.686651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2a71a-7d72-40c3-a087-282ec5563dd3 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.688160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 109/220] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:20.693156 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:20.693444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:20.693716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:20.716248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:20.718033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:20.721357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:20.762547 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:20.765144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:20.805601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 110/221] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:20.885252 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 112/222] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:20.891494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.901094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:20.990692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:20.992289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:21.014534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d42b45-f954-4fd4-85f8-61a4f7c329cc None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.040972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902cfd-bf18-4d4b-a250-83e67886b207 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.054542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.055275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.055484 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.055747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.056915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:21.058418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:21.060693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:20 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:21.069694 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.097976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.098620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.098901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.099216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.111315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:21.116354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:21.117239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:21.118021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 113/224] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:21.119166 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.187282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce88ba-08d3-4cb1-b3fb-0388fe121f53 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.225451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.226069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.226348 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.226619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.227397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=31d2a21b98784443be7c74f7ef058d58) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:21.227708 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:21.229163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:21.233474 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8392-bf77-4c83-b130-3cb3708511c5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.235965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 112/225] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/role_assignments?user.id=31d2a21b98784443be7c74f7ef058d58&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:21.236931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.253831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:21.267568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:21.276799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.277659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.278010 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.278413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.291546 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:21.298698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:21.299744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:21.300530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 114/226] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:21.310162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.421332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ae9a-5fde-4814-b510-13aa3161639a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.453169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d858c-3ed1-45fc-9e94-0c4d34e4e8d2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.492545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.493382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.493731 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.494072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.494801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:21.495198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:21.496862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:21.506957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 115/227] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:21.511794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.512583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.513015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.513417 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.514766 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:21.515248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:21.516849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:21.521070 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.527198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 113/228] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:21.532984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.603570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:21.685457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba699-6338-4758-8b32-70fbb66e91b3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.691464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:21.727266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758edb-249c-4fcb-8799-9c462714e43c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.760641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.761223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.761503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.761776 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] PATH_INFO: `/v3/users/e0f9ccf92ca74e26a7c62e15358172b4` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.763983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] RBAC: Authorizing `identity:get_user(user_id=e0f9ccf92ca74e26a7c62e15358172b4)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:21.765461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:21.767135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 116/229] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/users/e0f9ccf92ca74e26a7c62e15358172b4 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:21.772553 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.786714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:21.787870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:21.788341 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:21.788802 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] PATH_INFO: `/v3/users/e0f9ccf92ca74e26a7c62e15358172b4` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:21.790136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] RBAC: Authorizing `identity:get_user(user_id=e0f9ccf92ca74e26a7c62e15358172b4)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:21.791850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:21.793703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/users/e0f9ccf92ca74e26a7c62e15358172b4 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:21.802003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:21.958199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62aa9e-3007-4b43-bca8-94067d83153e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:21.995543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:21.996412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3fae-25dc-4ec9-8b29-3f7fb2ed9aaf None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:22.001914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:22.002556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:22.002835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:22.003123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:22.004355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:22.005797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:22.007466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:22.015484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:22.058786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:22.059724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:22.060004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:22.060279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:22.061575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:22.063023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:22.064689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:21 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:22.070606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:22.084637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:22.186049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cd8f5-668c-4306-ab22-967b1836e82c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:22.237348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4e71-d46b-408c-9665-b1d58832a8dc None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:22.268134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d207e8-94ca-477f-98bb-3f456704a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:22.268685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d207e8-94ca-477f-98bb-3f456704a163 None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:22.268966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d207e8-94ca-477f-98bb-3f456704a163 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:22.269295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d207e8-94ca-477f-98bb-3f456704a163 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/e0f9ccf92ca74e26a7c62e15358172b4/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:22.271308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d207e8-94ca-477f-98bb-3f456704a163 None admin] RBAC: Authorizing `identity:create_grant(project_id=41145c84270d4c0a9cdbb54115d46dfa, user_id=e0f9ccf92ca74e26a7c62e15358172b4, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:22.272754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d207e8-94ca-477f-98bb-3f456704a163 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:22.286686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b246781-903f-4b1a-82c9-b81daa665424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:22.287895 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b246781-903f-4b1a-82c9-b81daa665424 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:22.291122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b246781-903f-4b1a-82c9-b81daa665424 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:22.292664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b246781-903f-4b1a-82c9-b81daa665424 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/e0f9ccf92ca74e26a7c62e15358172b4/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:22.297335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b246781-903f-4b1a-82c9-b81daa665424 None admin] RBAC: Authorizing `identity:create_grant(project_id=41145c84270d4c0a9cdbb54115d46dfa, user_id=e0f9ccf92ca74e26a7c62e15358172b4, role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:22.299198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 116/233] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:22 2022] PUT /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/e0f9ccf92ca74e26a7c62e15358172b4/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:22.300516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b246781-903f-4b1a-82c9-b81daa665424 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:22.329958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:22 2022] PUT /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/e0f9ccf92ca74e26a7c62e15358172b4/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:23.374705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbef34-7b8b-4327-8126-efa84e06978d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:23.375726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbef34-7b8b-4327-8126-efa84e06978d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:23.376229 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbef34-7b8b-4327-8126-efa84e06978d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:23.377902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 117/235] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:23.385289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa5ea-5439-473c-b022-e40df210904d None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:23.386265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa5ea-5439-473c-b022-e40df210904d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:23.386761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa5ea-5439-473c-b022-e40df210904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:23.416286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-86cfa5ea-5439-473c-b022-e40df210904d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:23.417869 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-86cfa5ea-5439-473c-b022-e40df210904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:23.480481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:23.516500 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 119/236] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:23.526490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37efd-271a-4657-b21b-0a08c13a9e59 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:23.526773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37efd-271a-4657-b21b-0a08c13a9e59 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:23.527048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37efd-271a-4657-b21b-0a08c13a9e59 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:23.528399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 118/237] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:23.533820 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c04dd-172f-4b6f-950d-9eebe6a50c6c None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:23.534113 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c04dd-172f-4b6f-950d-9eebe6a50c6c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:23.534398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c04dd-172f-4b6f-950d-9eebe6a50c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:23.557581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-e17c04dd-172f-4b6f-950d-9eebe6a50c6c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:23.558756 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e17c04dd-172f-4b6f-950d-9eebe6a50c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:23.656432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 120/238] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:23.769358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215f7b3-0cff-4d52-87ce-ea0c5f753dcd None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:23.769540 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215f7b3-0cff-4d52-87ce-ea0c5f753dcd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:23.769817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215f7b3-0cff-4d52-87ce-ea0c5f753dcd None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:23.771175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 119/239] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:23.776579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:23.776870 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:23.777142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:23.801373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:23.802570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:23.893693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 121/240] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:23.893875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215f7b3-0cff-4d52-87ce-ea0c5f753dcd None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:23.972002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:23.988266 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.020007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215f7b3-0cff-4d52-87ce-ea0c5f753dcd None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.062903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:24.071124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.071124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.071124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.071124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.088591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:24.097721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:24.098600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:24.099423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 120/241] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:24.105290 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.213203 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e4fa-1334-4342-b797-fe35aa6f1b4f None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.227313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c0d94-9993-41a3-926f-b469df668d4c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.259015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:24.265994 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.266599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.266877 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.267173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.268032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:24.268542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:24.270188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:24.280638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 121/242] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:24.281789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.288594 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.289446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.289890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.290310 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.292190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:24.294690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:24.297300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 122/243] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:24.298200 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.407260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50012464-8174-4208-86d0-eae7f7dc2066 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.413422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67010b9e-2b74-4d5d-9533-f88982ac8472 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.447468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:24.452319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.453303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.453412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.453918 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.454042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.454227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.454503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.454897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] PATH_INFO: `/v3/users/f68c422d5dcf4235b03ba6298bf6afe2` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.468572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:24.470498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] RBAC: Authorizing `identity:get_user(user_id=f68c422d5dcf4235b03ba6298bf6afe2)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:24.472267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:24.474444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:24.476579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:24.477534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 122/244] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:24.478726 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 123/245] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/users/f68c422d5dcf4235b03ba6298bf6afe2 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:24.478804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.481245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.538354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:24.590155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca4bbd-3b91-4b52-94bc-05aee5c35222 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.623983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be472-cc31-4825-8388-5b23bc07de33 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.629743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.630583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.631054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.631559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.632409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:24.634124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:24.667246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 123/246] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:24 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:24.667246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.671334 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.671966 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.672248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.673299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.747488 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:24.822735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:24.824572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:24.834978 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8960c5-2477-4fa4-b877-d8c09206ef27 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:24.845635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:24.875659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:24.876185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:24.876466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:24.876738 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:24.877490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:24.877804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:24.879544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:24.889012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:24.894672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:24.955560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 124/248] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:24.965159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:25.025429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e896f-6000-42e4-b896-eb614ab53341 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:25.043608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:25.077487 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1331e1-48da-4281-8aab-ca8340571c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:25.078054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1331e1-48da-4281-8aab-ca8340571c8e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.078333 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1331e1-48da-4281-8aab-ca8340571c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.079318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1331e1-48da-4281-8aab-ca8340571c8e None admin] PATH_INFO: `/v3/users/31d2a21b98784443be7c74f7ef058d58` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.080846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1331e1-48da-4281-8aab-ca8340571c8e None admin] RBAC: Authorizing `identity:get_user(user_id=31d2a21b98784443be7c74f7ef058d58)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:25.082502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1331e1-48da-4281-8aab-ca8340571c8e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:25.087028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 125/249] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/users/31d2a21b98784443be7c74f7ef058d58 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:25.087028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef18dc0-0131-4be4-8692-74dd5bffb091 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.087028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef18dc0-0131-4be4-8692-74dd5bffb091 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.087028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef18dc0-0131-4be4-8692-74dd5bffb091 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.093967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 126/250] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:25.093967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef18dc0-0131-4be4-8692-74dd5bffb091 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:25.099363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091535-3b99-4d6d-b78b-e6e0be2c86fe None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:25.145227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77862597-2429-46eb-9bb2-602418381dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:25.145873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77862597-2429-46eb-9bb2-602418381dea None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.146155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77862597-2429-46eb-9bb2-602418381dea None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.146428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77862597-2429-46eb-9bb2-602418381dea None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.147660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77862597-2429-46eb-9bb2-602418381dea None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:25.149135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77862597-2429-46eb-9bb2-602418381dea None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:25.150786 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 125/251] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:24 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:25.151637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:25.151954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1340f-94f0-46f5-8269-1d0b9b79ae2f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.152234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1340f-94f0-46f5-8269-1d0b9b79ae2f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.152503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1340f-94f0-46f5-8269-1d0b9b79ae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.178337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-cfc1340f-94f0-46f5-8269-1d0b9b79ae2f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:25.178337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-cfc1340f-94f0-46f5-8269-1d0b9b79ae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:25.228506 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef18dc0-0131-4be4-8692-74dd5bffb091 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:25.268609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7c5df-3678-4eb5-88ef-79dff9361b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:25.269255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7c5df-3678-4eb5-88ef-79dff9361b43 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.269534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7c5df-3678-4eb5-88ef-79dff9361b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.269807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7c5df-3678-4eb5-88ef-79dff9361b43 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.270558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 126/252] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:25.271600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac06d-8406-4c3e-ac6b-7147fd73b26b None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.271887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac06d-8406-4c3e-ac6b-7147fd73b26b None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.272160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac06d-8406-4c3e-ac6b-7147fd73b26b None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.273531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 127/253] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:25.274907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdac06d-8406-4c3e-ac6b-7147fd73b26b None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:25.276028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7c5df-3678-4eb5-88ef-79dff9361b43 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:25.277566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7c5df-3678-4eb5-88ef-79dff9361b43 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:25.280424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 127/254] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:25 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:25.282054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.282337 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.282611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.322855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:25.324099 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:25.351495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:25.399037 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdac06d-8406-4c3e-ac6b-7147fd73b26b None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:25.473849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 128/255] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:25.478044 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:25.482422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:25.483978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.485519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.489442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.490409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] RBAC: Adding query filter params (role.id=1d3b687e66b840ed8e51b39e1a59ed7b, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=f68c422d5dcf4235b03ba6298bf6afe2) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:25.490915 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:25.492639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:25.508449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 128/256] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:25 2022] GET /identity/v3/role_assignments?user.id=f68c422d5dcf4235b03ba6298bf6afe2&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=1d3b687e66b840ed8e51b39e1a59ed7b => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:25.533565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:25.623692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:25.631669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d81cf-b0c2-467c-9e22-a6112b685b0b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:25.690893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:25.691676 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.692238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.692344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/31d2a21b98784443be7c74f7ef058d58/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.696041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] RBAC: Authorizing `identity:create_grant(project_id=41145c84270d4c0a9cdbb54115d46dfa, user_id=31d2a21b98784443be7c74f7ef058d58, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:25.697519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:25.726157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 129/257] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:25 2022] PUT /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/31d2a21b98784443be7c74f7ef058d58/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:25.743418 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938947-a461-4d88-9db7-544c4311f5b2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:25.771904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:25.785702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:25.786354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:25.786629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:25.786897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:25.800128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:25.805736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:25.806700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:25.807513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:25.811494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 129/258] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:25.813914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:25.835275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:26.000457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:26.021521 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafeb14-7347-47ff-b34a-5366415fd212 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.029270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3237b6-f7e6-47d7-9198-07bb88cb59ab None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.066411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.067136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.067409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.067684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.079325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:26.084811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:26.085685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:26.086533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 130/259] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:26.093894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.094228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:26.094524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.094800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.095073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.095775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:26.096073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:26.097474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:26.114355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 130/260] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:26.120049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:26.151493 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:26.204694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732408c1-058b-4584-b7ee-b02caba55b00 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.249928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.250728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.250958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.251266 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.251963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:26.252271 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:26.253800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:26.263858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 131/261] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:26.270112 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:26.291000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776ac3d-832b-4d22-a4b7-7bc01a492143 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.358213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.359040 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.359344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.359621 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] PATH_INFO: `/v3/users/e0f9ccf92ca74e26a7c62e15358172b4` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.360802 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f9ccf92ca74e26a7c62e15358172b4)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:26.362261 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:26.365132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 131/262] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:26 2022] GET /identity/v3/users/e0f9ccf92ca74e26a7c62e15358172b4 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:26.369600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:26.380137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874a56-e604-4e4b-b5bc-50c4b857c857 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.391473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:26.412927 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:26.418536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.419373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.419809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.420451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] PATH_INFO: `/v3/users/e0f9ccf92ca74e26a7c62e15358172b4` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.422175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f9ccf92ca74e26a7c62e15358172b4)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:26.423834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:26.426363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 132/263] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:26 2022] GET /identity/v3/users/e0f9ccf92ca74e26a7c62e15358172b4 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:26.431867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:26.547843 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427f7f-7c68-4c60-9603-9b6afaeade46 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.606549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.608055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.608483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.608990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.610940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3260-895f-496f-8877-a06259243753 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:26.658433 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:26.659057 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:26.659365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:26.659639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:26.688428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:26.768196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:26.769671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:26.806840 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:26.808398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:26.867459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:27.006583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 133/264] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:27.007575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 132/265] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:27.013102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:27.013551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:27.163532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:27.203915 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d39ec5-890b-4714-9403-b1d074f6e850 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:27.254068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:27.254704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:27.254989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:27.255293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:27.256435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:27.257911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:27.260112 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 134/266] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:27 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:27.267834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:27.293009 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f359b33-58bb-4c1b-a849-03dd0dd5fc02 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:27.360803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:27.381128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:27.381772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:27.382048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:27.382318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:27.387779 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:27.389797 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:27.391784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 133/267] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:27 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:27.399789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:27.491280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e156b-50b8-4514-9dc2-5b4faaf87193 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:27.559622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:27.561491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:27.561986 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:27.562431 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:27.563348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] RBAC: Adding query filter params (role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=e0f9ccf92ca74e26a7c62e15358172b4) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:27.563801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:27.565430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daf19c-bb63-4507-acc9-a271fca4f25c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:27.572329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 135/268] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:27 2022] GET /identity/v3/role_assignments?user.id=e0f9ccf92ca74e26a7c62e15358172b4&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:27.622294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad768ef-a96d-45d4-8ff5-4c1ebbcca3bf None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:27.673460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:27.674161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:27.674439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:27.674711 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:27.675478 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=e0f9ccf92ca74e26a7c62e15358172b4) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:27.675787 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:27.677255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d51-8db9-47e7-9c21-c79dfdf64045 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:27.689329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 134/269] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:27 2022] GET /identity/v3/role_assignments?user.id=e0f9ccf92ca74e26a7c62e15358172b4&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:27.941542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c106-2438-48ff-b427-68fc87239b62 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:27.941888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c106-2438-48ff-b427-68fc87239b62 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:27.942094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c106-2438-48ff-b427-68fc87239b62 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:27.943697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 136/270] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:27.951885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11697a3d-cbf3-4726-875b-3b544aa0c68f None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:27.952172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11697a3d-cbf3-4726-875b-3b544aa0c68f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:27.952448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11697a3d-cbf3-4726-875b-3b544aa0c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:27.973455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-11697a3d-cbf3-4726-875b-3b544aa0c68f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:27.974802 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-11697a3d-cbf3-4726-875b-3b544aa0c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:28.040963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:28.056073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 135/271] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:28.352796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c106-2438-48ff-b427-68fc87239b62 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:28.362341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:28.398602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fa25e-b7f0-4b19-825d-80a0b45c9370 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.398877 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fa25e-b7f0-4b19-825d-80a0b45c9370 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.399185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fa25e-b7f0-4b19-825d-80a0b45c9370 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.400678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 136/272] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:28.408786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.409071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.409348 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.429835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:28.431764 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:28.487614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c106-2438-48ff-b427-68fc87239b62 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:28.523742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:28.531695 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd310b-6f72-4343-a53f-55ad64841570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:28.532606 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd310b-6f72-4343-a53f-55ad64841570 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.533130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd310b-6f72-4343-a53f-55ad64841570 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.533597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd310b-6f72-4343-a53f-55ad64841570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.534890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd310b-6f72-4343-a53f-55ad64841570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:28.536592 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd310b-6f72-4343-a53f-55ad64841570 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:28.538353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 137/274] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:28.544930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:28.653812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55483485-731a-445d-8b93-754ffbdbc175 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:28.677026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:28.698588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cf577-15a0-4ab6-b457-a349a476ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:28.699243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf577-15a0-4ab6-b457-a349a476ce0f None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.699526 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf577-15a0-4ab6-b457-a349a476ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.699797 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf577-15a0-4ab6-b457-a349a476ce0f None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.700471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cf577-15a0-4ab6-b457-a349a476ce0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:28.702493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cf577-15a0-4ab6-b457-a349a476ce0f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:28.725031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 138/275] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:28 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:25:28.768187 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f197-f171-4b57-bca9-205f70070c90 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.769121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f197-f171-4b57-bca9-205f70070c90 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.769598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f197-f171-4b57-bca9-205f70070c90 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.771464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 138/276] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:28.776792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.777101 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.777374 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.798753 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:28.800008 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:28.803533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346acf4-51a1-457e-af96-63c46bc36974 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.803891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346acf4-51a1-457e-af96-63c46bc36974 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.804229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346acf4-51a1-457e-af96-63c46bc36974 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.805689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 139/277] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:28.811876 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:28.812600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:28.813195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:28.836833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:28.838385 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:28.883450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 139/278] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:28.885188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:28.918569 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 140/279] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:29.005723 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d459a-81c5-4b5d-a04f-56895411bae7 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.008280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.041914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.042473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.042747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.043015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.053716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:29.058650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:29.059824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:29.061246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 140/280] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:29.068337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.072579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.176879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.192986 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eedc36-2bd5-4a8f-b7c5-e2a6a3dca085 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.238937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.239851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.239851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.240122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.240797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:29.241097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:29.242469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:29.252925 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 141/281] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:29.253661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.316570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf4e5-0690-4148-bb90-e32149c16d81 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.348287 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.354345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.355110 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.355412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.355687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.367367 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:29.372975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:29.374652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:29.375483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:29.376125 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.390607 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a73c9-9185-4c1c-bd30-67ff96fdc32e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.415427 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.445245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.446439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.446902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.447618 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.462109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:29.468243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:29.469368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:29.470338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:29.471302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:29.476702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.514838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25633e61-7c4a-499e-bfe4-03c077a39b9c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.551175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.551814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.552104 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.552580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] PATH_INFO: `/v3/users/b04cec0cca364ec49216a46878387af4` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.567642 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] RBAC: Authorizing `identity:get_user(user_id=b04cec0cca364ec49216a46878387af4)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:29.569255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:29.571614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 142/284] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/users/b04cec0cca364ec49216a46878387af4 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:29.571858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.612398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef42b8-4c0e-4ab1-bfbe-63d8e40e8c9f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.652994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.660011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.668994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.670703 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.671227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.672137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.673316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:29.674040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:29.676386 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:29.680851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13fb2-5472-4067-9c6d-ab7b1b5c8e08 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.688378 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 143/285] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:29.690049 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.718278 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.719241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.719352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.719707 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.720483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:29.720852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:29.722376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:29.736476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 143/286] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:29.736476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.844764 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489a0e7-d184-4d0a-8639-e8b84e277912 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.847416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2574841-fa45-4bf6-90a4-b2d37d862389 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:29.883668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.884459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.884834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.885210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] PATH_INFO: `/v3/users/31d2a21b98784443be7c74f7ef058d58` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.886449 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] RBAC: Authorizing `identity:get_user(user_id=31d2a21b98784443be7c74f7ef058d58)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:29.888052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:29.890266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/users/31d2a21b98784443be7c74f7ef058d58 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:29.891269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.892022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:29.892798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:29.893225 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:29.893659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:29.894844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, user.id=b04cec0cca364ec49216a46878387af4, scope.system=all) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:29.895338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:29.897845 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:29.905430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 144/288] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/role_assignments?user.id=b04cec0cca364ec49216a46878387af4&scope.system=all&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:29.906851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:29.909303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:29.982073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:30.046169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a8d3c-a197-4e5d-ad50-c5fc2a92ad14 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:30.079942 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246550b-a570-4961-9dd6-f28f63f2efba None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:30.090740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:30.092357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:30.092849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:30.093322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:30.166631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:30.167223 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:30.167508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:30.167782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] PATH_INFO: `/v3/users/f68c422d5dcf4235b03ba6298bf6afe2` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:30.172027 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] RBAC: Authorizing `identity:get_user(user_id=f68c422d5dcf4235b03ba6298bf6afe2)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:30.173289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:30.174415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:30.179124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/users/f68c422d5dcf4235b03ba6298bf6afe2 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:30.180385 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:30.196192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:30.252991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:30.311134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 145/290] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:30.320640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:30.394017 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:30.430481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420807b8-5589-4459-9436-47c3a0503761 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:30.449192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfcb94-fc9d-4649-a632-772c3f61bc05 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:30.473091 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:30.473781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:30.474190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:30.474469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:30.476720 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:30.478169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:30.487259 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 146/291] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:30 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:30.492350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:30.523891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:30.524529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:30.524811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:30.525084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:30.527399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:30.528839 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:30.534769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:30.535459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 146/292] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:30 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:30.539299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:30.686278 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8051b7-80e1-42fa-b603-6acfcf6f3b8b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:30.694073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09ad40-0f64-42b3-bfb8-744496639e07 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:30.744694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:30.745304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:30.745587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:30.745862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:30.746594 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=31d2a21b98784443be7c74f7ef058d58) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:30.746902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:30.748911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac653b3-ab0e-411b-b1be-ffe3d805fae0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:30.755806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8da3-745a-4a8f-9c86-cf66ea01c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:30.756482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8da3-745a-4a8f-9c86-cf66ea01c22f None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:30.756758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8da3-745a-4a8f-9c86-cf66ea01c22f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:30.757032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8da3-745a-4a8f-9c86-cf66ea01c22f None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/f68c422d5dcf4235b03ba6298bf6afe2/roles/1d3b687e66b840ed8e51b39e1a59ed7b` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:30.760075 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8da3-745a-4a8f-9c86-cf66ea01c22f None admin] RBAC: Authorizing `identity:create_grant(project_id=41145c84270d4c0a9cdbb54115d46dfa, user_id=f68c422d5dcf4235b03ba6298bf6afe2, role_id=1d3b687e66b840ed8e51b39e1a59ed7b)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:30.761519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8da3-745a-4a8f-9c86-cf66ea01c22f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:30.765838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 147/293] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:30 2022] GET /identity/v3/role_assignments?user.id=31d2a21b98784443be7c74f7ef058d58&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:30.792043 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 147/294] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:25:30 2022] PUT /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/users/f68c422d5dcf4235b03ba6298bf6afe2/roles/1d3b687e66b840ed8e51b39e1a59ed7b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:31.483615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ef8b-8929-470c-b2cf-1e7b95e59c86 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:31.484156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ef8b-8929-470c-b2cf-1e7b95e59c86 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:31.484156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ef8b-8929-470c-b2cf-1e7b95e59c86 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:31.487028 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 148/295] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:31.491481 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:31.491772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:31.492050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:31.510502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:31.511717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:31.513788 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:31.547763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87d1c9-a5ce-48b7-9cce-70d42a71db0a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:31.548067 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87d1c9-a5ce-48b7-9cce-70d42a71db0a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:31.548326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87d1c9-a5ce-48b7-9cce-70d42a71db0a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:31.549846 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 149/296] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:31.554594 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:31.554877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:31.555177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:31.573810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:31.575007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:31.593619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 148/297] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:31.646105 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 150/298] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:31.871680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:31.921173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:31.937044 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:31.980821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83fe89-86e8-47f2-8868-b316ceffb794 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.018275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.019280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.019784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.020327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.021722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:32.023535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:32.025349 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 149/299] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:32.026609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fbaad-15a4-4d80-803f-cc5bb9ba74a8 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.032335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:32.041412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:32.064226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.064970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.065257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.065533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.076771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:32.082205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:32.083299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:32.084190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:32.088311 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 151/300] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:32.089222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:32.151853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901634-c2df-47d1-9d3f-5cd7a13071e9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.176233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:32.192448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa01b3-77f3-4b56-a39f-9bf1da145da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.193290 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa01b3-77f3-4b56-a39f-9bf1da145da6 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.193737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa01b3-77f3-4b56-a39f-9bf1da145da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.194151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa01b3-77f3-4b56-a39f-9bf1da145da6 None admin] PATH_INFO: `/v3/groups` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.194923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa01b3-77f3-4b56-a39f-9bf1da145da6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:32.196757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa01b3-77f3-4b56-a39f-9bf1da145da6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:32.205769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2f4d-d692-4a2f-a378-fccdef70e565 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.221721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 150/301] 10.222.0.18 () {60 vars in 1134 bytes} [Fri Sep 9 04:25:32 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:32.245280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.245909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.246191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.246463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.246731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c3077-40e8-4e27-8d89-969120c7ead0 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.247026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c3077-40e8-4e27-8d89-969120c7ead0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.247212 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:32.247358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c3077-40e8-4e27-8d89-969120c7ead0 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.247457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:32.249414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:32.249622 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 151/302] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:32.255559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.255855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.256122 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.259972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 152/303] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:32.268214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:32.284360 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:32.285628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:32.354695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:32.371602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 152/304] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:32.386410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6606d1-49c3-48e4-927e-332524c4cec7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.424242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.425093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.425516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.425947 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] PATH_INFO: `/v3/users/9a38e0ff86474c61899eb745e6736d50` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.429880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:32.442591 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] RBAC: Authorizing `identity:get_user(user_id=9a38e0ff86474c61899eb745e6736d50)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:32.444405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:32.446255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:32 2022] GET /identity/v3/users/9a38e0ff86474c61899eb745e6736d50 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:32.452789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:32.558379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff0375-f71d-475d-bdb2-da3162cf9c67 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.595378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.596274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.596726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.597201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.598102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] RBAC: Adding query filter params (role.id=1d3b687e66b840ed8e51b39e1a59ed7b, user.id=9a38e0ff86474c61899eb745e6736d50, scope.system=all) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:32.598599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:32.600239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:32.606245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 9 04:25:32 2022] GET /identity/v3/role_assignments?user.id=9a38e0ff86474c61899eb745e6736d50&scope.system=all&role.id=1d3b687e66b840ed8e51b39e1a59ed7b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:32.658794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:32.774772 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2477e8-ed21-4665-81e9-aaa2b67cd923 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.812349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.813348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.813833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.814326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.825314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:32.831183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:32.832050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:32.832817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:32.835322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 154/307] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:32.841334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:32.903690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:32.948905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456c324-3dfd-412c-b26d-858fc2f5e456 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:32.986413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:32.987031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:32.987341 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:32.987616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:32.988411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:32.988717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:32.990116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bca551-8e3c-4216-b910-05aff44ef94b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:32.999745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 154/308] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:33.005333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:33.071433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:33.119541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46c8f-7294-4db3-941f-da9ef4030dd1 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:33.147671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7c70-d042-4de7-86d8-7313dc575cec None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:33.147972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7c70-d042-4de7-86d8-7313dc575cec None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:33.148223 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7c70-d042-4de7-86d8-7313dc575cec None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:33.150840 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 155/309] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:33.155037 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:33.155409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:33.155769 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:33.158830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:33.159804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:33.160285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:33.160782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] PATH_INFO: `/v3/users/b04cec0cca364ec49216a46878387af4` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:33.162127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] RBAC: Authorizing `identity:get_user(user_id=b04cec0cca364ec49216a46878387af4)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:33.164083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:33.166031 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:33 2022] GET /identity/v3/users/b04cec0cca364ec49216a46878387af4 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:33.172495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:33.177442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:33.178876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:33.258872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 156/311] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:33.289529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38555a2-53bd-4972-930e-62a1425488d2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:33.314635 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:33.327247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:33.328180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:33.328674 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:33.329138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] PATH_INFO: `/v3/system/users/b04cec0cca364ec49216a46878387af4/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:33.330745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b04cec0cca364ec49216a46878387af4, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:33.332381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:33.342871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 156/312] 10.222.0.18 () {58 vars in 1334 bytes} [Fri Sep 9 04:25:33 2022] PUT /identity/v3/system/users/b04cec0cca364ec49216a46878387af4/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 04:25:33.545145 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:33.598247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:33.648001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1872d1-bcea-484a-a359-dca578195b23 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:33.688141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:33.688791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:33.689071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:33.689347 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:33.700273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:33.705254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:33.706127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:33.707047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 157/313] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:33.713908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:33.824046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005132-cc6a-47fb-9440-151d2cd6adb0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:33.861069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:33.861608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:33.861890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:33.862162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:33.862955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:33.863295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:33.864737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:33.874268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:33.879937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:33.985334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cdbc6-816b-4317-8428-daf2afd61a24 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:34.000288 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:34.022501 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:34.023151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.023437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.023706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] PATH_INFO: `/v3/users/f68c422d5dcf4235b03ba6298bf6afe2` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.024898 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] RBAC: Authorizing `identity:get_user(user_id=f68c422d5dcf4235b03ba6298bf6afe2)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:34.026362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:34.032872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:33 2022] GET /identity/v3/users/f68c422d5dcf4235b03ba6298bf6afe2 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:34.034328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:34.088117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:34.143198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503d97-c2a6-4e81-bb92-eefe74d66f92 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:34.178953 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:34.179593 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.179873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.180145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.250983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:34.252491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:34.304566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:34.363023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:34.364382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:34.478275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077355f4-c0c7-4eae-b3c1-8110048966fc None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:34.518263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b7381-bf91-49e8-98eb-69abbadd7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:34.519379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7381-bf91-49e8-98eb-69abbadd7f42 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.519865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7381-bf91-49e8-98eb-69abbadd7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.520340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7381-bf91-49e8-98eb-69abbadd7f42 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.521697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b7381-bf91-49e8-98eb-69abbadd7f42 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:34.523405 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b7381-bf91-49e8-98eb-69abbadd7f42 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:34.525267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:34 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:34.531856 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:34.611761 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe653-4c42-4257-bda3-1e74aa11b2f0 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.612046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe653-4c42-4257-bda3-1e74aa11b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.612558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe653-4c42-4257-bda3-1e74aa11b2f0 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.614353 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 160/318] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:34.619722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856325-22f5-449c-abd8-1f0a9a1612ee None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.620228 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856325-22f5-449c-abd8-1f0a9a1612ee None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.620704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856325-22f5-449c-abd8-1f0a9a1612ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.636366 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4d04e-3a9a-4137-aefa-7081f52af357 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:34.639200 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ef856325-22f5-449c-abd8-1f0a9a1612ee None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:34.640716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ef856325-22f5-449c-abd8-1f0a9a1612ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:34.675960 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:34.676839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.677373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.677819 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.678806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] RBAC: Adding query filter params (role.id=1d3b687e66b840ed8e51b39e1a59ed7b, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa, user.id=f68c422d5dcf4235b03ba6298bf6afe2) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:34.679288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:34.680867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9bc31-788c-41ff-a4ff-20ebae4f6707 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:34.695535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:34.695826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 159/319] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:25:34 2022] GET /identity/v3/role_assignments?user.id=f68c422d5dcf4235b03ba6298bf6afe2&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=1d3b687e66b840ed8e51b39e1a59ed7b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:34.720579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:34.956084 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa4b20-81d9-4171-9a37-960119703509 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.957051 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa4b20-81d9-4171-9a37-960119703509 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.957543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa4b20-81d9-4171-9a37-960119703509 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.959103 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 160/321] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:34.964456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:34.964747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:34.965019 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:34.984622 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:34.985815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:34.995904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa4b20-81d9-4171-9a37-960119703509 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:35.012125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:35.067116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 162/322] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:35.109375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa4b20-81d9-4171-9a37-960119703509 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:35.143557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:35.144181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.144458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.144726 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.145798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:35.147257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:35.148849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 161/323] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:35.155037 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:35.264265 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c21d-33a5-49aa-a7c8-87080807692f None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:35.273699 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:35.300327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:35.300930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.301206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.301474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] PATH_INFO: `/v3/groups` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.302111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:35.303578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:35.319756 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 163/324] 10.222.0.18 () {60 vars in 1134 bytes} [Fri Sep 9 04:25:35 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:25:35.336189 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:35.430752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:35.454566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9d963-25f1-415c-89e4-8dd1cc4e8e6c None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:35.496078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b904027-c08b-4c09-8c00-5aab50486dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:35.496996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b904027-c08b-4c09-8c00-5aab50486dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.497399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b904027-c08b-4c09-8c00-5aab50486dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.497894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b904027-c08b-4c09-8c00-5aab50486dc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.510652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b904027-c08b-4c09-8c00-5aab50486dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-3b904027-c08b-4c09-8c00-5aab50486dc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:35.516908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:35.517864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:35.518646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 162/325] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:35.525257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:35.613903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcb484-cfcd-413c-8142-2c5f65bc029c None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.614227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcb484-cfcd-413c-8142-2c5f65bc029c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.614466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcb484-cfcd-413c-8142-2c5f65bc029c None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.616099 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 163/326] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:35.621070 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.621355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.621627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.640042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f23f16-cf16-40a8-9397-528968c1efde None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:35.640851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:35.642964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:35.680142 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:35.681117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.681405 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.681682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.682629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:35.682938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:35.685103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:35.696426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:35.702415 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:35.731931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 164/328] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:35.736490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:35.815600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a203b42-4ec7-4b86-b637-bc4d82997774 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:35.857205 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:35.857205 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:35.858010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:35.858262 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] PATH_INFO: `/v3/users/9a38e0ff86474c61899eb745e6736d50` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:35.860052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=9a38e0ff86474c61899eb745e6736d50)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:35.861560 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:35.863365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:35 2022] GET /identity/v3/users/9a38e0ff86474c61899eb745e6736d50 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:35.868913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:35.955264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:35.992156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fd51b-1545-4935-a18f-08bf391b4120 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:36.015783 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:36.038782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:36.039502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:36.039753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:36.040024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] PATH_INFO: `/v3/system/users/9a38e0ff86474c61899eb745e6736d50/roles/1d3b687e66b840ed8e51b39e1a59ed7b` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:36.042019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a38e0ff86474c61899eb745e6736d50, role_id=1d3b687e66b840ed8e51b39e1a59ed7b)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:36.043740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:36.054625 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 165/330] 10.222.0.18 () {58 vars in 1334 bytes} [Fri Sep 9 04:25:35 2022] PUT /identity/v3/system/users/9a38e0ff86474c61899eb745e6736d50/roles/1d3b687e66b840ed8e51b39e1a59ed7b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:36.140323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:36.144633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d4d9-ef21-4394-894d-aa9fd6cdc3e2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:36.185701 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:36.186741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:36.187020 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:36.187326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:36.200356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:36.207068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:36.208041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:36.208803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:36.216323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:36.342332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a828d7f-4f44-484f-93d5-4a4b1b7f71c5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:36.383689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:36.384304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:36.384577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:36.384845 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:36.385526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:36.385820 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:36.387207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:36.389601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:36.403784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:36.406352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:36.527508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e830fb-7b93-497c-8bff-4b89c0c95af5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:36.565498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80489621-996e-4418-be99-4a6c299d3209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:36.566207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80489621-996e-4418-be99-4a6c299d3209 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:36.566492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80489621-996e-4418-be99-4a6c299d3209 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:36.566768 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80489621-996e-4418-be99-4a6c299d3209 None admin] PATH_INFO: `/v3/users/b04cec0cca364ec49216a46878387af4` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:36.567963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80489621-996e-4418-be99-4a6c299d3209 None admin] RBAC: Authorizing `identity:get_user(user_id=b04cec0cca364ec49216a46878387af4)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:36.569419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80489621-996e-4418-be99-4a6c299d3209 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:36.571000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 167/333] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:36 2022] GET /identity/v3/users/b04cec0cca364ec49216a46878387af4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:36.577034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:36.702825 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66c2b7-88ce-4e54-ab52-c406a5d03117 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:36.744024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:36.745029 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:36.745506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:36.745971 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:36.746896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] RBAC: Adding query filter params (role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, user.id=b04cec0cca364ec49216a46878387af4, scope.system=all) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:36.747420 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:36.749604 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e16063-6b3a-4086-b396-37675f908b7f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:36.762524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 9 04:25:36 2022] GET /identity/v3/role_assignments?user.id=b04cec0cca364ec49216a46878387af4&scope.system=all&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:38.150368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd965b23-6455-45ff-9550-affcf8aca102 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:38.150884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd965b23-6455-45ff-9550-affcf8aca102 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:38.150884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd965b23-6455-45ff-9550-affcf8aca102 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:38.152512 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 168/335] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:38.159030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4f27-9526-4b59-b522-88d7b4bc980d None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:38.159497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4f27-9526-4b59-b522-88d7b4bc980d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:38.159676 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4f27-9526-4b59-b522-88d7b4bc980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:38.178452 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-cc6a4f27-9526-4b59-b522-88d7b4bc980d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:38.179727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-cc6a4f27-9526-4b59-b522-88d7b4bc980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:38.241659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:38.269289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 168/336] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:38.471518 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30a0e-ab1f-40b3-a36e-1b6ec73f8e92 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:38.471980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30a0e-ab1f-40b3-a36e-1b6ec73f8e92 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:38.472084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30a0e-ab1f-40b3-a36e-1b6ec73f8e92 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:38.473689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 169/337] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:38.478899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:38.479216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:38.479487 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:38.503558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:38.504972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:38.596199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:38.725827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30a0e-ab1f-40b3-a36e-1b6ec73f8e92 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:38.756637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:38.847003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30a0e-ab1f-40b3-a36e-1b6ec73f8e92 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:38.882345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:38.882970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:38.883277 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:38.883542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:38.894876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:38.900105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:38.900980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:38.901793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 170/339] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:38.908282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:39.011465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:39.090899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec006c-c5e3-4cc2-8fe0-933a1596a851 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:39.120145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:39.162775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:39.163565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.163775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.164044 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.164826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:39.165128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:39.166494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:39.181764 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:39.188628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:39.191448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:39.222879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c26eba-49da-4370-8cd3-392ed5112707 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:39.296141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b2aa4-8e96-4f74-aab2-626667d96a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:39.296828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2aa4-8e96-4f74-aab2-626667d96a44 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.297103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2aa4-8e96-4f74-aab2-626667d96a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.297373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2aa4-8e96-4f74-aab2-626667d96a44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.320091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b2aa4-8e96-4f74-aab2-626667d96a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-ff3b2aa4-8e96-4f74-aab2-626667d96a44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:39.327011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:39.328117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:39.328892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:39.335517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 171/341] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:39.336864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731caa98-11de-4ba2-8a0c-4a496b293d09 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.337150 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731caa98-11de-4ba2-8a0c-4a496b293d09 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.337427 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731caa98-11de-4ba2-8a0c-4a496b293d09 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.338972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 172/342] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:39.339567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731caa98-11de-4ba2-8a0c-4a496b293d09 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:39.362106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551d52-5c88-4131-a502-9e6a2b95be14 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:39.423049 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bd5f-fa86-48cf-83ae-52bfe1c2c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:39.423702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bd5f-fa86-48cf-83ae-52bfe1c2c739 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.423984 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bd5f-fa86-48cf-83ae-52bfe1c2c739 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.424255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bd5f-fa86-48cf-83ae-52bfe1c2c739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.484665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:39.488438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731caa98-11de-4ba2-8a0c-4a496b293d09 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:39.516358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bd5f-fa86-48cf-83ae-52bfe1c2c739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:39.517873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bd5f-fa86-48cf-83ae-52bfe1c2c739 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:39.544185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:39.544999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.545303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.545604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.546302 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:39.546553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:39.547979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e298e82-0370-4569-bde6-76b8faa66548 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:39.556972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 173/343] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:39.558302 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9edb2-e635-490d-b263-bb4288ed7dd5 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.558548 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9edb2-e635-490d-b263-bb4288ed7dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.558823 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9edb2-e635-490d-b263-bb4288ed7dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.581024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-90a9edb2-e635-490d-b263-bb4288ed7dd5 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:39.582144 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-90a9edb2-e635-490d-b263-bb4288ed7dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:39.584266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:39.642922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 171/344] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:39.644610 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0bf3-5541-427f-ac35-7509367fc51a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.645088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0bf3-5541-427f-ac35-7509367fc51a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.645551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0bf3-5541-427f-ac35-7509367fc51a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.646999 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 172/345] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:39.647920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0bf3-5541-427f-ac35-7509367fc51a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:39.675180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 174/346] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:39.676834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.677329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.677793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.696895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:39.698382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:39.797862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:39.807037 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 175/347] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:39.808060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:39.848927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0bf3-5541-427f-ac35-7509367fc51a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:39.918918 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:39.919800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:39.920159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:39.920441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:39.924372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:39.968246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ce759-e074-46ba-8023-490b1e74dff6 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.005578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.006213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.006490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.006763 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.007934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.009381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.011296 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 176/348] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:39 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:40.017436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.053216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.054605 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.151390 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3b5f-97e2-49cd-86b1-56bf49c44c28 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.202503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.203957 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.204436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.204923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.211504 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:40.214945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.216585 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.223189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 177/349] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:40.224294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.282381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:40.334714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 173/350] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:40.340228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.352391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7721e-90df-490b-993c-82382a39cbd8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.392954 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.393986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.394468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.394940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.407603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:40.413461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:40.414549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 04:25:40.416108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:40.418068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 178/351] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:40.418994 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.479074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd0439-8a4b-466c-90a3-487febfcdc3b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.501088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:40.530943 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.532085 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.532370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.532934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.533715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=8e0efab51db14b88959d3315ce33c6fa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:40.534028 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.536054 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.545670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 174/352] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:40.546408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.549428 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797f75a-8398-4980-9637-db2c25e385dc None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.592499 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dc4aa-6427-4fb2-9201-8549c169ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.593057 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc4aa-6427-4fb2-9201-8549c169ac7b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.593334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc4aa-6427-4fb2-9201-8549c169ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.593610 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dc4aa-6427-4fb2-9201-8549c169ac7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.607006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dc4aa-6427-4fb2-9201-8549c169ac7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b36dc4aa-6427-4fb2-9201-8549c169ac7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:40.613006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:40.613948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:40.614743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 179/353] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:40.615457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74347898-e617-4311-870a-f644d784a078 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.616026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74347898-e617-4311-870a-f644d784a078 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.616026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74347898-e617-4311-870a-f644d784a078 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.617491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 180/354] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:40.618086 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74347898-e617-4311-870a-f644d784a078 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.619536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:40.710979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab4f0-967f-4907-99f5-723250794693 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.755045 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74347898-e617-4311-870a-f644d784a078 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.759957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.760926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.761411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.761902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.765809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.767994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.770630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 175/355] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:40.771982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.782207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:40.805114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.805892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.806269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.806646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.807455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:40.807861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.809604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a99f48-4192-48f0-8047-c86aed3eb98a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.819012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 181/356] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:40.820876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.820876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.821235 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.842454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:40.844143 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:40.901173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe30a-be19-46ff-bf5f-3544a52992a5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:40.911250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:40.936615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 182/357] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:40.937474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:40.952868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:40.953977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:40.954448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:40.954934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:40.955806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:40.956299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:40.958952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:40.971397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 176/358] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:40.973090 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.065727 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e227f-05f6-416a-bb5c-9cdab688e1d0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.085456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.087826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dafe4-bc9f-4502-b394-5a93bd08dcb1 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.111588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984d5a-9161-4314-bd7a-d1176f99cb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.112520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984d5a-9161-4314-bd7a-d1176f99cb7e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.112968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984d5a-9161-4314-bd7a-d1176f99cb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.113505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984d5a-9161-4314-bd7a-d1176f99cb7e None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.114927 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984d5a-9161-4314-bd7a-d1176f99cb7e None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:41.116759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984d5a-9161-4314-bd7a-d1176f99cb7e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:41.118750 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 183/359] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:41.120952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc512-6000-4dd5-81e5-de20e7ebf259 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.121514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc512-6000-4dd5-81e5-de20e7ebf259 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.121980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc512-6000-4dd5-81e5-de20e7ebf259 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.124447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 184/360] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:41.125460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc512-6000-4dd5-81e5-de20e7ebf259 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.134518 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a7554-45df-43d9-af9b-207e7af50c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.135184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7554-45df-43d9-af9b-207e7af50c8d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.135473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7554-45df-43d9-af9b-207e7af50c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.135746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7554-45df-43d9-af9b-207e7af50c8d None admin] PATH_INFO: `/v3/users/9a38e0ff86474c61899eb745e6736d50` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.136903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a7554-45df-43d9-af9b-207e7af50c8d None admin] RBAC: Authorizing `identity:get_user(user_id=9a38e0ff86474c61899eb745e6736d50)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:41.138514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a7554-45df-43d9-af9b-207e7af50c8d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:41.140501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 177/361] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:25:40 2022] GET /identity/v3/users/9a38e0ff86474c61899eb745e6736d50 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:41.141538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.141824 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.142085 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.163713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:41.165213 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:41.205669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.260950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 178/362] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:41.261617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.279628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc512-6000-4dd5-81e5-de20e7ebf259 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.327842 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.328805 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.329276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.329758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.405161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.407414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be7ce1-cf6b-4967-bc78-a97bf58ba809 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.434426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:41.436267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:41.449838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.452728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.453226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.453694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.454640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=8e0efab51db14b88959d3315ce33c6fa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:41.455186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:41.456835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:41.463664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 179/363] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:41.464698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.508568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.575381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 185/364] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:41.577128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.674031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.684554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90f05-ad61-4368-8566-7676b59ce898 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.706162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e32fe-8792-46af-9e6c-fc9ed52cbe1a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.725957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.726570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.726851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.727158 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.727899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] RBAC: Adding query filter params (role.id=1d3b687e66b840ed8e51b39e1a59ed7b, user.id=9a38e0ff86474c61899eb745e6736d50, scope.system=all) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:41.728207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:41.729659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:41.745978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 180/365] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/role_assignments?user.id=9a38e0ff86474c61899eb745e6736d50&scope.system=all&role.id=1d3b687e66b840ed8e51b39e1a59ed7b => generated 510 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:41.745978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.760801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.761463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.761741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.762011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.784870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:41.790897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:41.791879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:41.792664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 186/366] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:41.793316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.885723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827b8d3-4724-40a4-ac79-ee9d18f69297 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.899522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.911310 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c7c4a-4b29-4a1b-8690-8bf8a9dd3f2e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:41.936890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.937941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.938462 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.939025 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.943326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:41.945339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:41.947494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 181/367] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:41.948668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:41.960029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:41.960696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:41.960978 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:41.961250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:41.979595 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:41.984711 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:41.991647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:41.992583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:41.993363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:41.995008 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 187/368] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:41.998182 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.127253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d8187-b101-4947-b6cb-7f6bd2fbd414 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:42.131302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3512-7d03-438a-a1ce-e2ff69c6446a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:42.168209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:42.168851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:42.169132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:42.169402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:42.170834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:42.172326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:42.174053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 188/369] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:42.174649 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.193395 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:42.194013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:42.194292 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:42.194563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:42.195260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:42.195563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:42.196955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:42.208064 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 182/370] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:42.208736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.248687 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:42.299380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:42.346141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395a23a-90e8-478e-aa66-4f44c698af73 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:42.348993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354bfe-b98e-4dd9-b2d2-353c9b3df5e4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:42.390899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:42.391545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:42.391822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:42.392111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:42.392753 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:42.393063 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:42.394422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:42.395040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:42.396120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:42.396603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:42.397446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:42.398391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:42.398955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:42.401106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:42.403690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 189/371] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:42.404480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.412572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 183/372] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:42 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:42.416039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.533007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad82b-665b-4e37-bc5b-e75a040470b5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:42.538136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:42.560982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae30a75-1111-4811-b53c-b9780fb2dd55 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:42.575229 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:42.584358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:42.585003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:42.585282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:42.585554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:42.610651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:42.611653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:42.612165 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:42.612657 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:42.670426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:42.671987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:42.711324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:42.713778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:42.811031 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:42.832427 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 190/373] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:42.837251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 184/374] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:42.840138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.845562 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:42.888905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:42.996189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9479c-ed61-4a68-9d64-d4934b7dc096 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:43.014335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe0bc6-b4c9-4e95-951a-9cba5e064883 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:43.048641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:43.049663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.050168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.050651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.052124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:43.054701 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:43.057074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 191/375] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:42 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:43.063194 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:43.079958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:43.080948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.081441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.081965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] PATH_INFO: `/v3/projects/2ce92404f91b4778925ef74e27275875` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.084299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] RBAC: Authorizing `identity:get_project(project_id=2ce92404f91b4778925ef74e27275875)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:43.085978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:43.090769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 185/376] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:42 2022] GET /identity/v3/projects/2ce92404f91b4778925ef74e27275875 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:43.121275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:43.219489 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:43.262220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516db922-5705-4e0d-9e07-6dbe8a7ac58c None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:43.310834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbefc9-1720-4d15-b329-3b7b83751771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:43.311530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbefc9-1720-4d15-b329-3b7b83751771 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.311852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbefc9-1720-4d15-b329-3b7b83751771 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.312129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbefc9-1720-4d15-b329-3b7b83751771 None admin] PATH_INFO: `/v3/groups/965c73b268b44b06893eb57ffe787553` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.325588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbefc9-1720-4d15-b329-3b7b83751771 None admin] RBAC: Authorizing `identity:get_group(group_id=965c73b268b44b06893eb57ffe787553)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:43.328018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbefc9-1720-4d15-b329-3b7b83751771 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:43.330093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 186/377] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:43 2022] GET /identity/v3/groups/965c73b268b44b06893eb57ffe787553 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:43.335118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a324-4361-4f08-9f5e-d7a2670d598a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.335118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a324-4361-4f08-9f5e-d7a2670d598a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.335118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a324-4361-4f08-9f5e-d7a2670d598a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.337466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:43.337898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 187/378] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:43.338645 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a324-4361-4f08-9f5e-d7a2670d598a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:43.344055 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126f3b2-2cb3-4c3f-aa68-2ea72e5b9702 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:43.388588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a3dc6-22f8-4083-bd53-f1e07ed503ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:43.389638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a3dc6-22f8-4083-bd53-f1e07ed503ff None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.390132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a3dc6-22f8-4083-bd53-f1e07ed503ff None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.390631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a3dc6-22f8-4083-bd53-f1e07ed503ff None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.392553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a3dc6-22f8-4083-bd53-f1e07ed503ff None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:43.397498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a3dc6-22f8-4083-bd53-f1e07ed503ff None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:43.402378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 192/379] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:43 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:43.402378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.402378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.402378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.438164 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:43.440519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:43.490232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a324-4361-4f08-9f5e-d7a2670d598a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:43.509855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:43.532332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:43.533226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.533692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.534151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.535053 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] RBAC: Adding query filter params (group.id=965c73b268b44b06893eb57ffe787553, role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=2ce92404f91b4778925ef74e27275875) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:43.535588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:43.537675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:43.543693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 188/380] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:43 2022] GET /identity/v3/role_assignments?group.id=965c73b268b44b06893eb57ffe787553&scope.project.id=2ce92404f91b4778925ef74e27275875&role.id=d4776e2384644965a0ae59d37530328f => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:43.545476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:43.555260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 193/381] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:43.671711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593278c-2f2e-4c40-861b-dfcc5d1cc5e4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:43.711608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:43.712553 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:43.713030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:43.713485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:43.714413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:43.714897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:43.716950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:43.723607 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 189/382] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:43 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:43.974006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:44.093100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:44.100089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dbd5c-333a-4b0b-81b0-a50e1db2eeed None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:44.143741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:44.144379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.144659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.144930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.158241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:44.163320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:44.164221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:44.165568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 194/383] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:44.170233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:44.241697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:44.304315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae05e-5f6b-4d84-8bc1-19117f6f1c17 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:44.340921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:44.342080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.342355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.342624 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.343338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:44.343640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:44.345071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c825f-c4d6-41db-8a94-eb7f90848b37 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:44.355188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 190/384] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:44.361916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:44.468543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4793a8-4bc0-4c54-a73f-047bd926c1a6 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.468543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4793a8-4bc0-4c54-a73f-047bd926c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.468829 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4793a8-4bc0-4c54-a73f-047bd926c1a6 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.471258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 191/385] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:44.475210 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.475484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.475749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.502597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c65f0-2425-404e-b009-fe8a1089ed7d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:44.516416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:44.517366 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:44.543329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:44.544333 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.545370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.545844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.547294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:44.548960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:44.550777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 195/386] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:44 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:44.556686 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:44.607969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:44.673417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 192/387] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:44.697638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dedcad-cf0c-4c0b-8828-5d31df5a00de None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:44.738207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:44.738849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.739224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.739551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.740706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:44.742157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:44.744238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 196/388] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:44 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:44.750037 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:44.797933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:44.876241 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013499d-435f-45b3-85a9-2926a98384e9 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:44.917891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a655b4-a14f-4a90-8ee6-730b1f8e56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:44.918555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a655b4-a14f-4a90-8ee6-730b1f8e56de None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:44.918830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a655b4-a14f-4a90-8ee6-730b1f8e56de None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:44.919126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a655b4-a14f-4a90-8ee6-730b1f8e56de None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:44.921903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a655b4-a14f-4a90-8ee6-730b1f8e56de None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0efab51db14b88959d3315ce33c6fa, group_id=4ce19f8eb74f4a0d8a77101f45830f69, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:44.923360 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a655b4-a14f-4a90-8ee6-730b1f8e56de None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:44.947079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 193/389] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 9 04:25:44 2022] PUT /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:45.064386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:45.194493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:45.206226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59492e5-6a82-4b3e-ae18-17880fdcc5ba None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:45.251800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5cd5-d274-4a62-a7b4-6f7208f57d15 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:45.252101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5cd5-d274-4a62-a7b4-6f7208f57d15 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:45.252477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5cd5-d274-4a62-a7b4-6f7208f57d15 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:45.253816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 194/390] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:45.259647 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:45.259922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:45.260024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:45.260209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:45.260580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:45.260861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:45.261128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:45.274204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:45.280496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:45.281393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:45.282210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 197/391] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:45.282868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:45.284023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:45.292097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:45.385516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 195/392] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:45.460561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac6cb-ce5c-4762-b0d3-70bcba1a4177 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:45.503894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:45.504510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:45.504785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:45.505053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:45.505722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:45.506019 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:45.507430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:45.519873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 198/393] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:45.525465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:45.554375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:45.643992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779178-3db8-4671-a866-e2d4bbc62dee None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:45.681827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:45.682471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:45.682751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:45.683024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:45.684423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:45.686286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:45.687889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 196/394] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:45 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:45.693505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:45.711207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:45.810827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66649208-1870-400b-bf24-927bc0970e8b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:45.851712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:45.852416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:45.852699 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:45.852976 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:45.859772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:45.861238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:45.863134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 199/395] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:45 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:45.869020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:45.971709 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:45.980213 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2db700-bf06-42cb-a630-2fc867d97ff3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:45.986656 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:46.029931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:46.031130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.031571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.032050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.035562 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=8e0efab51db14b88959d3315ce33c6fa, group_id=4ce19f8eb74f4a0d8a77101f45830f69, role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:46.037165 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:46.061945 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 197/396] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 9 04:25:45 2022] PUT /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:46.100346 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:46.124793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afddcc8-65cd-4734-8c63-cb6aa25f4f21 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:46.165891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:46.166548 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.166830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.167210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.179984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:46.186402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:46.187423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:46.188206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 200/397] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:46.195661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:46.329510 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f5c2e-88fa-43f2-b7db-32e1611b1d6d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:46.366446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:46.367403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.367873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.368327 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.369181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:46.369653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:46.371247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:46.381271 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 198/398] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:46.387497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:46.502126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fba40-f888-43bc-93b1-027f2aa15ffe None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:46.537985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808b199-f413-4788-8360-82c4c347d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:46.538908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808b199-f413-4788-8360-82c4c347d821 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.539444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808b199-f413-4788-8360-82c4c347d821 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.539892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808b199-f413-4788-8360-82c4c347d821 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.541291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808b199-f413-4788-8360-82c4c347d821 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:46.542901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808b199-f413-4788-8360-82c4c347d821 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:46.545024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 201/399] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:46 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:46.550700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:46.577224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:46.679750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168069b-e10b-43f9-93b2-d9191e8191b8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:46.716067 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:46.717180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.717640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.718083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.719455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:46.721071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:46.723292 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 199/400] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:46 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:46.728938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045e62-1ca8-49d3-892d-e5075cf42db4 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.729309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045e62-1ca8-49d3-892d-e5075cf42db4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.729659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045e62-1ca8-49d3-892d-e5075cf42db4 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.729777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:46.731471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 202/401] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:46.738253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388dd81-2811-42a5-b5d7-c38ef6845d90 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.738632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388dd81-2811-42a5-b5d7-c38ef6845d90 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.738982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388dd81-2811-42a5-b5d7-c38ef6845d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.760309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a388dd81-2811-42a5-b5d7-c38ef6845d90 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:46.761664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a388dd81-2811-42a5-b5d7-c38ef6845d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:46.766878 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:46.837200 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:46.855075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e246-b838-437f-9b83-98a5cb495693 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:46.898248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257293b-dc94-4bae-bcf1-8d2069ba05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:46.899224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257293b-dc94-4bae-bcf1-8d2069ba05ce None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:46.899652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257293b-dc94-4bae-bcf1-8d2069ba05ce None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:46.900086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257293b-dc94-4bae-bcf1-8d2069ba05ce None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:46.904404 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257293b-dc94-4bae-bcf1-8d2069ba05ce None admin] RBAC: Authorizing `identity:create_grant(project_id=41145c84270d4c0a9cdbb54115d46dfa, group_id=4ce19f8eb74f4a0d8a77101f45830f69, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:46.906377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257293b-dc94-4bae-bcf1-8d2069ba05ce None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:46.908355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 203/402] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:46.944239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 200/403] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 9 04:25:46 2022] PUT /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 04:25:47.198263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ce6a0-6635-4046-8bc5-14c1e05b7afe None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:47.198754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ce6a0-6635-4046-8bc5-14c1e05b7afe None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:47.199162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ce6a0-6635-4046-8bc5-14c1e05b7afe None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:47.201136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 204/404] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:47.206896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:47.207363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:47.207741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:47.209747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ce6a0-6635-4046-8bc5-14c1e05b7afe None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:47.233008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:47.234246 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:47.318732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 201/405] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:47.357475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ce6a0-6635-4046-8bc5-14c1e05b7afe None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:47.401547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:47.402177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:47.402455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:47.402721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:47.410812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:47.414485 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:47.420624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:47.421514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:47.422308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 205/406] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:47.429367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:47.518199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:47.553269 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69c3b-2e72-4c48-860e-b049fdade510 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:47.596159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:47.596773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:47.597048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:47.597314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:47.597980 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:47.598273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:47.599664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:47.609767 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 202/407] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:47.616393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:47.680660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:47.781352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d682f-1e70-409c-bf8d-eaa164a16192 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:47.798860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f732-9e7e-41c6-b1ce-92018d7f4891 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:47.816212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:47.817040 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:47.817161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:47.817368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] PATH_INFO: `/v3/groups/965c73b268b44b06893eb57ffe787553` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:47.818526 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] RBAC: Authorizing `identity:get_group(group_id=965c73b268b44b06893eb57ffe787553)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:47.819954 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:47.827138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 206/408] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:47 2022] GET /identity/v3/groups/965c73b268b44b06893eb57ffe787553 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:47.832803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:47.865341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:47.866264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:47.868106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:47.868567 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:47.879496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:47.899648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:47.911375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:47.912333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:47.913111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:47.920938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:47.967354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:48.011233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09d621-e320-4319-94db-2d242fae0ce4 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.048092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0eb59-f831-4a41-b21d-46273468201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.049063 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0eb59-f831-4a41-b21d-46273468201f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.049554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0eb59-f831-4a41-b21d-46273468201f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.050025 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0eb59-f831-4a41-b21d-46273468201f None admin] PATH_INFO: `/v3/projects/2ce92404f91b4778925ef74e27275875` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.051401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0eb59-f831-4a41-b21d-46273468201f None admin] RBAC: Authorizing `identity:get_project(project_id=2ce92404f91b4778925ef74e27275875)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:48.053073 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0eb59-f831-4a41-b21d-46273468201f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:48.055215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:47 2022] GET /identity/v3/projects/2ce92404f91b4778925ef74e27275875 => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:48.056757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72db33-eadf-4ee7-9b2d-0b2b50a3973f None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.057237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72db33-eadf-4ee7-9b2d-0b2b50a3973f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.057705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72db33-eadf-4ee7-9b2d-0b2b50a3973f None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.063237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 208/411] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:48.065886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.066375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.066869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.087132 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b393a-5c88-42dd-b100-4c30d08f0d91 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.089418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:48.092365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:48.125826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.126815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.127320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.127854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.128868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:48.129412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:48.131127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:48.147163 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 204/412] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:48.148274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:48.183138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 209/413] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:48.183138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:48.264437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:48.272049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:48.310943 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dc336-f999-4f92-9707-b64612ab05c1 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.340713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e65e4a-7037-4f04-9bef-41a4ee17e7b9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.348376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.349214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.349621 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.350032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.351300 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:48.352885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:48.354598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 210/414] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:48 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:48.360995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:48.415126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.415916 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.416197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.416464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] PATH_INFO: `/v3/projects/2ce92404f91b4778925ef74e27275875/groups/965c73b268b44b06893eb57ffe787553/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.420753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce92404f91b4778925ef74e27275875, group_id=965c73b268b44b06893eb57ffe787553, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:48.422193 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:48.449330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 205/415] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 9 04:25:48 2022] PUT /identity/v3/projects/2ce92404f91b4778925ef74e27275875/groups/965c73b268b44b06893eb57ffe787553/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:48.472834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c41b9-7b52-4d2c-ad6a-5149e17857a4 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.513071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.514265 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.514701 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.515152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.516580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:48.518189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:48.520309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 211/416] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:48 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:48.526482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:48.573201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:48.576717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:48.661172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24a1a3-912e-426a-b853-2e2992c08798 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.683667 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:48.699550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000283f-5512-42c4-b3de-d19f47820eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.700218 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000283f-5512-42c4-b3de-d19f47820eb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.700534 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000283f-5512-42c4-b3de-d19f47820eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.701023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000283f-5512-42c4-b3de-d19f47820eb3 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.703462 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000283f-5512-42c4-b3de-d19f47820eb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=41145c84270d4c0a9cdbb54115d46dfa, group_id=4ce19f8eb74f4a0d8a77101f45830f69, role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:48.705038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000283f-5512-42c4-b3de-d19f47820eb3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:48.723038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 206/417] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 9 04:25:48 2022] PUT /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa/groups/4ce19f8eb74f4a0d8a77101f45830f69/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:25:48.773878 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404d392-fd56-4eac-9953-5db0ce1636b1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:48.789665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103b76-3afe-415f-b2bf-49d706ab5d62 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.789964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103b76-3afe-415f-b2bf-49d706ab5d62 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.790215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103b76-3afe-415f-b2bf-49d706ab5d62 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.792043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 207/418] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:48.797795 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.798114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.798337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.820793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:48.822800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:48.837457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:48.838076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:48.838400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:48.838673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:48.857800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:48.869490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:48.870444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:48.871295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:48.872912 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 212/419] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:48.882723 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:48.954135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 208/420] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:48.984447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:49.027602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4892-ebfc-47c0-adea-cc8d5093d956 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.064597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:49.065215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.065495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.065770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.066549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:49.066860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:49.068297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:49.077678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 213/421] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:49.083256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:49.214203 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b194-6388-44f7-aa81-d67cb955b479 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.227729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:49.246682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:49.258215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:49.259370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.259659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.259931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.378589 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:49.380227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:49.441078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8ca11-3b8b-47e4-9c80-255104716d3e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.486932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:49.493852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:49.494769 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.495411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.495902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.506971 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:49.513010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:49.513880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:49.514668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:49.517508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 214/422] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:49.528253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:49.535282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 209/423] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:49.543813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:49.566949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:49.697897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c243-2b25-4c36-b768-bdcb5fb11249 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.734596 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:49.735260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.735539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.735811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.737012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:49.738690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:49.746088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 210/424] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:49 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:49.746088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:49.769097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b80f4-88cb-4e72-8c2e-e8c3c9e84a72 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.808258 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:49.808868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.809421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.809757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.811408 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:49.811737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:49.813118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:49.828611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 215/425] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:49.834221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:49.878172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:49.892247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:49.908376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9ac0-98e5-4deb-9eeb-3ff7f931f4eb None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.946349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6368e-b416-426f-a6f3-2d24484cf6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:49.947133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6368e-b416-426f-a6f3-2d24484cf6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.949747 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6368e-b416-426f-a6f3-2d24484cf6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.950086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6368e-b416-426f-a6f3-2d24484cf6f5 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.951575 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6368e-b416-426f-a6f3-2d24484cf6f5 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:49.953131 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6368e-b416-426f-a6f3-2d24484cf6f5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:49.955051 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 211/426] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:49 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:49.956178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdebb-f186-4dca-a250-281c72cb4066 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.956545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdebb-f186-4dca-a250-281c72cb4066 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.956876 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdebb-f186-4dca-a250-281c72cb4066 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.962290 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 212/427] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:49.963556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:49.963835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:49.964107 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:49.974247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8b708-8802-4dfe-9ea7-626f4995a608 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:49.984746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:49.986087 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:50.020969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.021940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.022674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.023180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.067117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 213/428] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:50.067117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.144834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:50.146303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:50.210794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:50.224609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:50.265567 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff6d1-6b33-478a-99ac-5c5a25cd773e None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.319125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.319658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.319938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.320211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.320935 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=8e0efab51db14b88959d3315ce33c6fa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:50.321238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:50.322729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:50.329618 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 214/429] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:50.363739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:50.369264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.406921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.529844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6848f0-b9e7-4be6-b94f-3ce5b0a30c51 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.538798 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667e12a-f505-46bd-affb-725a10390f96 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.573902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.574964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.575546 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.576024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] PATH_INFO: `/v3/projects/8e0efab51db14b88959d3315ce33c6fa` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.577577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] RBAC: Authorizing `identity:get_project(project_id=8e0efab51db14b88959d3315ce33c6fa)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:50.579347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:50.581709 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/projects/8e0efab51db14b88959d3315ce33c6fa => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:50.587967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.592719 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.593263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.593604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.593938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.597622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:50.607336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:50.612806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:50.613706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:50.614498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 217/432] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:50.619626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.636259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:50.719519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646401da-ccc2-4ed0-b688-d38918015e80 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.750736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65babfb5-fda0-436b-b806-744444710e4c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.760339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.761084 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.761433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.764801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.766099 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:50.768041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:50.770654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:50.776967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.798083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.799220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.799637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.800593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.801706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] RBAC: Adding query filter params (name=member) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:50.802148 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:50.804465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:50.817685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:50.823153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:50.877309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:50.915840 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:50.917451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489912d9-918a-4e17-9885-902f73a64919 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.956785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae59d-c819-4179-ac4c-76760c30a73e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:50.961521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:50.962426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:50.962855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:50.963317 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:50.964231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=8e0efab51db14b88959d3315ce33c6fa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:50.964721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:50.967954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94f84e-712f-444e-9a35-9686a1d50abc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:50.976944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 217/435] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=8e0efab51db14b88959d3315ce33c6fa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:51.007281 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.008270 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.008751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.009251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.089617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:51.092181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:51.116597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7feab-2ef6-4e3c-9f2f-6b4f031dffc1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.116965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7feab-2ef6-4e3c-9f2f-6b4f031dffc1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.117151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7feab-2ef6-4e3c-9f2f-6b4f031dffc1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.118614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 218/436] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:51.126689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c464a3-d08f-4477-81ff-b3f70147e8ab None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.127042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c464a3-d08f-4477-81ff-b3f70147e8ab None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.127299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c464a3-d08f-4477-81ff-b3f70147e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.151693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-41c464a3-d08f-4477-81ff-b3f70147e8ab None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:51.153344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-41c464a3-d08f-4477-81ff-b3f70147e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:51.194707 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:51.241847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 219/437] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:25:51.248706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.277152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 219/438] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:51.364126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ff83-2342-49b1-a744-9a654dad7cd0 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.364406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ff83-2342-49b1-a744-9a654dad7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.364680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ff83-2342-49b1-a744-9a654dad7cd0 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.365996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 220/439] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:51.368950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5fab-51cb-4632-914f-5bab9dbf9d4b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:51.372183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.372341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.373093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.392745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:51.393921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:51.407257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.408222 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.408710 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.409158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.410491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:51.411982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:51.413895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 220/440] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:51.419825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.461108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:51.475838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:51.491410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 221/441] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:51.536773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342975bc-7f7f-450e-a99a-86872e54ec02 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:51.558088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.576103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.577178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.577458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.577726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.579207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:51.580317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:51.582082 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:51.588000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.676043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967f749-aea6-4be3-b32b-6609f6755670 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:51.704097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069e6f9-0785-4fcc-a8e5-da041d4df4c5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:51.707634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:51.713151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.713782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.714047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.714326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.725968 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:51.731376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:51.732912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:25:51.733882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:51.735775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 222/443] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:51.741284 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.744238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.744850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.745133 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.745408 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.746141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=625fe8b2be3e4e07bcd4a24aba0dce2d, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:51.746451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:51.748475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:51.754613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=625fe8b2be3e4e07bcd4a24aba0dce2d => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:51.767183 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.808208 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:51.864717 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9681a9-db6c-4152-b1de-5111044953c0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:51.878690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d75d-d4c5-4d67-afc4-9fc3d699893b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:51.905955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.906581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.906860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.907154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.907841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:51.908140 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:51.909541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:51.917343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:51.918264 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:51.918391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:51.918949 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:51.919590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:51.924343 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.931924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:51.937551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:51.938425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:51.939260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 223/446] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:51.946872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:51.978619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.043136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228d0a-f297-4f9e-8b40-7708c0673082 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.067069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6f36c-e7f4-4cea-8c68-66996452ab60 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.069256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.087479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.088100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.088365 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.088632 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.111413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.112021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.112295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.112570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.113234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:52.113540 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.115447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.124921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 224/447] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:52.130395 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.164097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.165551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.225654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.238186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7c0bf-0c47-4921-960d-e5bceb998f7d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.264905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 224/448] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:52.270429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.271364 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.271975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.272263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.272558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.291842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.340033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.341943 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.370168 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954faba-494a-4783-9d7a-8f981a2d6a25 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.404711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.405515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.405796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.406069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] PATH_INFO: `/v3/projects/2ce92404f91b4778925ef74e27275875` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.407229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] RBAC: Authorizing `identity:get_project(project_id=2ce92404f91b4778925ef74e27275875)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.408661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.410265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 225/449] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/projects/2ce92404f91b4778925ef74e27275875 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:52.415843 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.429100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.440446 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 225/450] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:25:52.446098 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.504556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.516451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019963b2-9aae-4c4c-92a9-cfec0b952f53 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.545028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98fd9a-57ad-4128-a0cd-34d14040a78c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.549856 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.550483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.550760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.551030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] PATH_INFO: `/v3/groups/965c73b268b44b06893eb57ffe787553` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.552162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] RBAC: Authorizing `identity:get_group(group_id=965c73b268b44b06893eb57ffe787553)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.553584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.555143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 226/451] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/groups/965c73b268b44b06893eb57ffe787553 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:52.561696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.580488 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.581114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.581394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.581659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] PATH_INFO: `/v3/projects/41145c84270d4c0a9cdbb54115d46dfa` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.582760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] RBAC: Authorizing `identity:get_project(project_id=41145c84270d4c0a9cdbb54115d46dfa)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.584235 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.585847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 226/452] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/projects/41145c84270d4c0a9cdbb54115d46dfa => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:52.591419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.648838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.661741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eddc9d-7d76-48ab-b301-906ca23c1f2f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.691048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63faca9-e439-4170-9838-7d3f7ab65513 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.696141 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.696746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.697027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.697300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.698026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] RBAC: Adding query filter params (group.id=965c73b268b44b06893eb57ffe787553, role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=2ce92404f91b4778925ef74e27275875) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:52.698331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.699802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.705894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/role_assignments?group.id=965c73b268b44b06893eb57ffe787553&scope.project.id=2ce92404f91b4778925ef74e27275875&role.id=d4776e2384644965a0ae59d37530328f => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:52.729128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae66cc-5e8e-4efb-9def-d8e2bab81bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.729773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae66cc-5e8e-4efb-9def-d8e2bab81bec None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.730046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae66cc-5e8e-4efb-9def-d8e2bab81bec None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.730312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae66cc-5e8e-4efb-9def-d8e2bab81bec None admin] PATH_INFO: `/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.731507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae66cc-5e8e-4efb-9def-d8e2bab81bec None admin] RBAC: Authorizing `identity:get_group(group_id=4ce19f8eb74f4a0d8a77101f45830f69)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.733874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae66cc-5e8e-4efb-9def-d8e2bab81bec None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.735574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/groups/4ce19f8eb74f4a0d8a77101f45830f69 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:52.741635 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:52.765979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:52.849683 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01e834-e243-4324-af17-7f5951ff9ea0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:52.885447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:52.886052 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:52.886332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:52.886605 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:52.887359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] RBAC: Adding query filter params (group.id=4ce19f8eb74f4a0d8a77101f45830f69, role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=41145c84270d4c0a9cdbb54115d46dfa) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:52.887721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:52.889189 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3708d-3450-47c3-a501-be715c40a256 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:52.898244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 9 04:25:52 2022] GET /identity/v3/role_assignments?group.id=4ce19f8eb74f4a0d8a77101f45830f69&scope.project.id=41145c84270d4c0a9cdbb54115d46dfa&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:55.504602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d39850-5fdd-49c8-a96c-092cec175191 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:55.505094 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d39850-5fdd-49c8-a96c-092cec175191 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:55.505094 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d39850-5fdd-49c8-a96c-092cec175191 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:55.506813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 228/456] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:55.512470 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015059b1-2cdc-49fd-83d4-a75acfe9c909 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:55.513406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015059b1-2cdc-49fd-83d4-a75acfe9c909 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:55.513406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015059b1-2cdc-49fd-83d4-a75acfe9c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:55.540630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-015059b1-2cdc-49fd-83d4-a75acfe9c909 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:55.541815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-015059b1-2cdc-49fd-83d4-a75acfe9c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:55.637888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 229/457] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:55.829847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfae84e-2259-4f42-8e9b-f4d9af13c850 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:55.830184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfae84e-2259-4f42-8e9b-f4d9af13c850 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:55.830306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfae84e-2259-4f42-8e9b-f4d9af13c850 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:55.831827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:55.836836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:55.837128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:55.837406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:55.864047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:55.865233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:55.875192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:55.921426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f950-0f14-405e-963c-43426c4702ed None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:55.921733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f950-0f14-405e-963c-43426c4702ed None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:55.921995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f950-0f14-405e-963c-43426c4702ed None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:55.923670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 230/459] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:55.928543 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:55.928835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:55.929087 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:55.952176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:55.953362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:55.980145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 230/460] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:56.040329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.063381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 231/461] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:56.201226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a68e3c-c96a-4454-97a5-c393a5f5c0b2 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.250998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:56.251665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.251943 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.252211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.270716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:56.272202 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:56.280190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:25:56.297597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:56.298544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:25:56.300003 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:25:56.300003 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:56.300003 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:56.300003 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 231/462] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:56.304604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.369519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:56.377952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.426214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22402f-4e96-4cad-bb87-aeb17ba8fa42 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.463170 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:56.463881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.464192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.464558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.465270 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:56.465643 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:56.467482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:56.493719 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 232/463] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:56.494561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.517005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d79a-ac1f-4430-b7ec-ec2d69e76a64 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.564784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:56.565789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.566267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.566890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.580948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:56.583325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:25:56.600799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:56.601712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:25:56.602560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:25:56.602560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:56.602560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:25:56.602560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:56.603242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.610471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5a335-236d-4202-987b-1801bdfe18d3 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.636660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:56.662339 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:56.663482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.663934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.664537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:56.665564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.680941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:56.682457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:25:56.700791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:56.701934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:25:56.702774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:25:56.702774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:56.702774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:56.702774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:56.702774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.736684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b2219-7c8d-4db9-aecb-4d5c2cfd1fc2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.772295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:56.772901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.773181 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.773452 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.774106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:56.775578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:56.804915 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 233/466] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:56 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:56.805747 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.831243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899d557-3516-4b82-abf5-f51dfbdf91cb None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.874682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:56.875668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.876144 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.876632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.877740 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:56.878217 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:56.879888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bbc04-a1a5-4fe7-a145-cac38cab57b8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:56.894322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 234/467] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:56.896958 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd04af-26e8-4967-822b-1c5a58a6a774 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:56.898159 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd04af-26e8-4967-822b-1c5a58a6a774 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:56.898813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd04af-26e8-4967-822b-1c5a58a6a774 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:56.901743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 235/468] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:56.902808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd04af-26e8-4967-822b-1c5a58a6a774 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:56.943675 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:56.966514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ab8b-38b2-4b82-b97b-4701c30684fe None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:56.970704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:57.011900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:57.012422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.012724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.013220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.013886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:57.014175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:57.016573 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e8ea6-0088-42d7-bb6f-bf49af57f52f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:57.033480 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 234/469] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:57.034871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1d5a-07f5-476a-8242-7148089f0a4f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.035245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1d5a-07f5-476a-8242-7148089f0a4f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.035507 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1d5a-07f5-476a-8242-7148089f0a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.047369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd04af-26e8-4967-822b-1c5a58a6a774 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:57.055732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-00fc1d5a-07f5-476a-8242-7148089f0a4f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:57.056932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-00fc1d5a-07f5-476a-8242-7148089f0a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:57.087623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:57.088226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.088508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.088784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.089424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:57.092366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:57.118601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 236/470] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:56 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:57.119549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:57.134179 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 235/471] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:25:57.261119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:57.281139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff7c03-92e4-41ec-95fd-954d69cb9420 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:57.334173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:57.334869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.335162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.335429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.336103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:57.338739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:57.343678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20a856-d26d-4305-9336-f27ca316a7c1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.343994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20a856-d26d-4305-9336-f27ca316a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.344262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20a856-d26d-4305-9336-f27ca316a7c1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.346062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 236/472] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:25:57.353963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.354273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.354506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.377686 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 237/473] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:57 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:25:57.389752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:57.390985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:57.483260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 237/474] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:25:57.538075 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:57.692002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f23e-29b4-4621-a277-5759bdeb5870 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:57.748023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:57.748831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:57.749119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:57.749394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:57.762082 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:57.764966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:57.766789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:25:57.786988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:57.787985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:25:57.788880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:25:57.788880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:25:57.788880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:57.788880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 238/475] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:57.797549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:57.806870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:57.829932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:57.991043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db5eed-c49d-4dec-8beb-decc1d1704e6 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:57.995983 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e10bf-587d-467a-b401-20d80ccb4316 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:58.054109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:58.054650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:58.054930 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:58.055246 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:58.055895 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:58.056196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:58.057584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:58.069785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:58.070403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:58.070678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:58.070947 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:58.071672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:58.073061 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:58.083558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 238/476] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:25:58.086533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.sql.core [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 04:25:58.086533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 04:25:58.086533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [parameters: {'id': 'f38ff20902c94abba0a88774432ab58b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 04:25:58.086533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 04:25:58.091737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application conn.query(q) Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application result.read() Sep 09 04:25:58.108033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 04:25:58.108938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application next(self.gen) Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application yield resource Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application next(self.gen) Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise self.value Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application session.commit() Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 04:25:58.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self.session.flush() Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application compat.raise_( Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 04:25:58.110733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 04:25:58.111648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application conn.query(q) Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application result.read() Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 04:25:58.112465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [parameters: {'id': 'f38ff20902c94abba0a88774432ab58b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:58.113236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 04:25:58.114089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:58.114921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 239/477] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 9 04:25:57 2022] POST /identity/v3/roles => generated 144 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:25:58.124704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:58.205059 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:58.224632 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8e8f-c9b8-4be7-9ad0-26a87a5de471 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:58.267115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:58.267735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:58.268015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:58.268284 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:58.268951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:58.270399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:58.297749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:58.313623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 239/478] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:25:58 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:25:58.374190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ecd39-033d-4931-829c-2540052a09b1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:58.423118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b851663-7ea5-46c1-bdc3-2bbd09c38531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:58.423830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851663-7ea5-46c1-bdc3-2bbd09c38531 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:58.424114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851663-7ea5-46c1-bdc3-2bbd09c38531 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:58.424391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851663-7ea5-46c1-bdc3-2bbd09c38531 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:58.440521 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b851663-7ea5-46c1-bdc3-2bbd09c38531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-5b851663-7ea5-46c1-bdc3-2bbd09c38531 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:25:58.445988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:25:58.446853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:25:58.447693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 240/479] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:25:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:25:58.454222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:25:58.589265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6f62-c606-4794-ae09-3e8646ff6737 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:25:58.635538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:25:58.636176 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:58.636448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:58.636714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:58.637414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:25:58.637839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:25:58.639305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ad354-782e-46e1-9700-db44d974f996 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:25:58.655491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 240/480] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:25:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:25:59.696904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633919a-cd96-40ab-9af0-75348d9d5d8d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:59.699420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633919a-cd96-40ab-9af0-75348d9d5d8d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:59.699420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633919a-cd96-40ab-9af0-75348d9d5d8d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:59.699895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 241/481] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:25:59.705579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfd12-4828-43ec-a8f3-112e97d8bf76 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:25:59.706359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfd12-4828-43ec-a8f3-112e97d8bf76 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:25:59.706783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfd12-4828-43ec-a8f3-112e97d8bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:25:59.718014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:25:59.732877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-a13cfd12-4828-43ec-a8f3-112e97d8bf76 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:25:59.734078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-a13cfd12-4828-43ec-a8f3-112e97d8bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:25:59.817385 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 241/482] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:00.209533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633919a-cd96-40ab-9af0-75348d9d5d8d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:00.277510 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd5573-6e89-4f53-8c81-be21957e0d4c None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.278128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd5573-6e89-4f53-8c81-be21957e0d4c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.278708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd5573-6e89-4f53-8c81-be21957e0d4c None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.282085 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 242/483] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:00.286473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8a6b-d9f6-4ef2-ae31-91443f92417c None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.287008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8a6b-d9f6-4ef2-ae31-91443f92417c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.287527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8a6b-d9f6-4ef2-ae31-91443f92417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.307907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-5dac8a6b-d9f6-4ef2-ae31-91443f92417c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:00.310488 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5dac8a6b-d9f6-4ef2-ae31-91443f92417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:00.348101 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633919a-cd96-40ab-9af0-75348d9d5d8d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:00.365745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:00.393965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:00.394949 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.403572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 243/484] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:26:00.403572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2e11d-eeae-47cf-83af-b07aff4a766a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.403572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2e11d-eeae-47cf-83af-b07aff4a766a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.403572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2e11d-eeae-47cf-83af-b07aff4a766a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.403572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 244/485] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:00.403914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.403914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.412642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.412921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.413192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.431045 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:00.437123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:00.438001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:00.438985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 242/486] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:00.444002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:00.449885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:00.451393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:00.557335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:00.582943 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 245/487] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:26:00.597689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d507e-0f98-465a-8470-bdfd96f995c9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:00.643765 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:00.644372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.644647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.644914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.645582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:00.645877 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:00.647274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:00.661003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 243/488] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:00.666816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:00.731992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:00.802361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:00.881196 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dd1e-4785-4820-b750-e190f04691e9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:00.885032 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b42db9-716c-4808-a985-6ace1a783cfc None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:00.921864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:00.922565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.923022 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.923450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.939471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:00.939835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:00.940130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:00.940409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:00.940683 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:00.946249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:00.947301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:00.948084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:00.951211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:00.952324 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:00.960133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:00.961617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:00.982919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:00.983888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:00.984763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:00.984763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:00.984763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:00.986851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 246/490] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:00.988047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.044384 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.078521 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.082343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52996e2-f921-4af2-aab2-b3337389cae0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.106938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed14b6-a74b-490c-86f5-5b6147b7a34a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.117816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.118455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.118734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.119111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.129936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:01.135814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:01.136702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:01.137494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 245/491] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:01.138863 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.148379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.148992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.149285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.149543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.150209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:01.150515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.151913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282032e8-494b-4557-ad86-85a5995b74a7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.161169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:01.162226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442c883-53c4-4326-a8eb-316f5311d595 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.162508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442c883-53c4-4326-a8eb-316f5311d595 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.162778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442c883-53c4-4326-a8eb-316f5311d595 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.164110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 248/493] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:01.168490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442c883-53c4-4326-a8eb-316f5311d595 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.254531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046acc-288b-4f22-8129-bf4ce37810d0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.287662 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442c883-53c4-4326-a8eb-316f5311d595 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.291981 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.292603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.292882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.293152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.293841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:01.294168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.295775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.297777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.311167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 246/494] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:01.312502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.328232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.328857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.329456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.329456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.330077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:01.330382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.331850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a18d2-51ab-40f7-92ce-6d85be03097d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.333812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.342211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 249/495] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:01.343493 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.343786 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.344056 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.362188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:01.363358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:01.429626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250804b-27c4-48ca-8b37-120ee01231de None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.438576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 250/496] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:01.439438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.472882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.473508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.473788 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.474060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.485738 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.487248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:01.502305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:01.503267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:01.504080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:01.504080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:01.504080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:01.504080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 247/497] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:01.504299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.548992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.552962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b27dd-c762-467a-b36c-64d46d04b090 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.578706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.592656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.593295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.593574 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.593848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.601468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.602917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.613021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe587-3c7f-405d-b08f-e91668076717 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-a74f2803-6e28-4665-872b-59ddc7c9c63f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:01.616349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:01.617298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:01.618185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 251/498] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:01.618743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890eb3f-2cd7-4230-8931-86661e5d62c9 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.619297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890eb3f-2cd7-4230-8931-86661e5d62c9 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.619297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890eb3f-2cd7-4230-8931-86661e5d62c9 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.625039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 252/499] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:01.625039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890eb3f-2cd7-4230-8931-86661e5d62c9 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.661510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.662141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.662419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.662699 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.673471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.674937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:01.689888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:01.690953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:01.692369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:01.692369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:01.692369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:01.695687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 248/500] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:01.696554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.735549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890eb3f-2cd7-4230-8931-86661e5d62c9 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.769740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.770338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.770620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.770894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.771567 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:01.771868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.773264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f45048-f0b2-49b3-8fe2-89fa4eb96758 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.784990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 253/501] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:01.786207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.786499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.786769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.799378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3947b-f46d-4e5f-977a-20989c69893e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.804530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:01.805730 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:01.819161 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.822085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:01.834548 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:01.835180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:01.835464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:01.835744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:01.836475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:01.836783 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:01.838218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:01.871295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 254/502] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:01.872157 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.878326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 249/503] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:01.878326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:01.983949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ec46f-529a-448a-a6ee-7f83db31bdcb None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:01.988848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16c646-fbc1-4dde-b989-962d3a2f51cc None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.018127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.018726 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.019000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.019290 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.019920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:02.020214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.021566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.026060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.026869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.027327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.027865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.032857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 255/504] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:02.033799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.043138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:02.046996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:02.051132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:02.052176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:02.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:02.055085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 250/505] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:02.056097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.101551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.145145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac56d4-73f5-4e89-bd0b-ab29398aa218 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.161353 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337bfc-f663-4fab-9b21-0d9ea78224f7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.178639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.179307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.179586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.179855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.187930 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.189369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.194746 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.195378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.195655 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.195948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:02.201024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:02.202171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 256/506] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:02.203498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.266236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.267759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.270771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.304535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467794f-e40e-4617-b90a-b66257b7e70f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.307759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.338388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.339006 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.339306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.339574 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.347428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.348865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:02.360412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:02.361379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 257/507] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:02.362245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.370318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 251/508] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:02.371172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.463982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ad9a-314c-4ef8-87b6-72d124dfb4b6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.468821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aadbf3-b2c8-4b9b-a3a9-6fd838a4dc93 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.490788 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.499422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.500049 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.500329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.500602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.501268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:02.501576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.502966 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.510456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.511057 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 258/509] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:02.511212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.511399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.511640 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.511855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.523031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.525349 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.526907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:02.542309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:02.543343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:02.544519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:02.544519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:02.544519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:02.544519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 252/510] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:02.544519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.618280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14c8dd-abb2-4364-b3cf-81444fcde214 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.644543 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f017a71-f220-4ea4-874a-593729591742 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.651228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.651827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.652105 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.652375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.653097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:02.653941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.655395 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.677591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.678189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.678471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.678747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.679511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:02.679814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.681258 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.692153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 259/511] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:02.692976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.704614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 253/512] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:02.704614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.743228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.750490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.794430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7f2a-1e61-4484-b96a-5c2d22a71cee None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.801414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15480c-143c-4287-9213-8ebcd3e99110 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.829334 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.829954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.830230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.830499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.836376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:02.837003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:02.837283 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:02.837557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:02.840570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.842054 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.847597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:02.849049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:02.860361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:02.861414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:02.862429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:02.862429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:02.862429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:02.862429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 260/513] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:02.862429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:02.863929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:02.864759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:02.865612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:02.865612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:02.865612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:02.865612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 254/514] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:02.866188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:02.963459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:02.967030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef09ba-ef05-4932-8773-84e0974ebde4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.967228 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8cf2-0fcc-402e-966b-c05a2974de2d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:02.968885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.001851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.002378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.002659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.002931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.004281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.004879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.005158 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.005434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.006064 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:03.006369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.007774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.019780 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 261/515] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:03.020578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.075362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.076844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.117356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbbe8-6546-437c-bfc2-e7f7f4540a26 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.152363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.152968 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.153251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.153518 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.173845 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 255/516] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:03.174686 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.176855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.187121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.234743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.235835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.276626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1031-b53e-46f7-a4f3-7808272b8794 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.310155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.310760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.311033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.311332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.311966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:03.312267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.313641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.324450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 256/517] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:03.325747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.343694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 262/518] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:03.343694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.389239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.399454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.428737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89052a28-a6cb-481f-8195-3cb73b839e57 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.440410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2416fea-bfbe-4785-a57c-68b788cb0f5e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.462443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.463050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.463361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.463633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.464274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:03.464575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.466067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.474607 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.475246 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.475528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.475828 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.476473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.477987 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.482472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 257/519] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:03.482472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.501603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 263/520] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:26:03 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:03.502426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.597935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b7abc-17af-415d-a887-11e22de0596a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.629919 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.639441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3180-7676-4446-bff7-ff73114e1391 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.651969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.653795 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.654273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.655028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.658894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.680704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.682663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.684861 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.685798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.686153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.686501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.694506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.696519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:03.702790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:03.703726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:03.704554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:03.704554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:03.704554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:03.705862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 258/521] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:03.706483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:03.713322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:03.714349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:03.715352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 264/522] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:03.720906 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.841774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e403b-ea94-46da-b750-21b8342fa679 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.858909 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192eaa3-fd3f-4321-916e-57cf79a2bba7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:03.895632 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.896277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.896556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.896831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.901829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:03.902569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:03.902970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:03.904099 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:03.905850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.907791 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.915996 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:03.921043 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:03.922456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:03.923527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 04:26:03.924595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:03.928333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 265/523] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:03.929193 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:03.940440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:03.941651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:03.942690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:03.942690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:03.942690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:03.948552 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 259/524] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:03.948552 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:03.977903 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:03.988494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.073699 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec16f5e-1e15-4620-997d-77c05f651e7a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.074623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66a50c-d585-48e1-9743-5657bb7c9187 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.110669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.111225 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.111511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.111786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.111995 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.112481 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:04.112786 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.112874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.113222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.113592 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.114300 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.114388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:04.114778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.116565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.131251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 266/525] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:04.132097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.139283 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 260/526] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:04.140297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.237772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.238001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.241179 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6a1b8-91ff-4f49-b5b8-0ed1954c52b2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.255843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1677c-37cc-4eb7-ba24-90581a23e99c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.280118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.280878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.281541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.281541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.282383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:04.282763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.284331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.294049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.294646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.294924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.295247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.295893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:04.296258 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.297782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.303499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 267/527] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:04.308089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.312728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 261/528] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:04.313134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.418083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc8134-1390-4a7a-82da-b974fee2b7e1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.418675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c867f-7146-4ec6-8cc7-1be7fb96ee32 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.455034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.455690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.455974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.456252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.456991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=d2fb8c8ee6324e4ba6c328a9c2450fde) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:04.457336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.458773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.458950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.459697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.460090 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.460457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.475538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 262/529] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/role_assignments?user.id=d2fb8c8ee6324e4ba6c328a9c2450fde&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:04.475538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.477492 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.479237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.489880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:04.493896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:04.495177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:04.496124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:04.496629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 268/530] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:04.497640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.523455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.603075 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e487c4-6280-4bde-9812-5d24ba638397 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.630684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c69889-39e6-4980-a0f4-049bdf00ca42 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.646737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.647460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.647737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.648169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.673071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.673928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.674400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.674794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.683879 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.685722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:04.698639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:04.699801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:04.701497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:04.705808 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 269/531] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:04.706669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.738730 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.741255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.755865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.816325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82853909-154b-49e1-8093-bcbffcf6fdf5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.819436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:04.857328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:04.857949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:04.858236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:04.858515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:04.859531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:04.860282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:04.862238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:04.869814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 263/532] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:04.870671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.889654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 270/533] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:04.890720 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:04.974698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fda37a-722d-4d59-a3de-0b995ca47aec None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:04.987696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:05.014463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.015071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.015377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.015650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.016024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a452236-3daa-4266-8a91-e7571c566b11 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.016346 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:05.016651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.019056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.033487 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 264/534] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:05.034348 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:05.056205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.056937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.057221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.057597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.067538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:05.071466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.073169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:05.092408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:05.093725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:05.094552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:05.094552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:05.094552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:05.094552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 271/535] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:05.094774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:05.176852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fbdb-85c7-4496-9842-6ab9b43e8726 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.219240 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd385d-0c2d-4245-a3ee-ea12cb72038a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.220849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.221599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.221977 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.222354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.223240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=9f896dfbd2ad452e9def2c11cfa97e53) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:05.223746 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.225410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.236603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 265/536] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:05 2022] GET /identity/v3/role_assignments?user.id=9f896dfbd2ad452e9def2c11cfa97e53&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:05.236603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:05.260907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.262065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.262794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.263295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.264184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=71f71f58204a4569bf6d937b6691c2f5) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:05.264505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.266146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.272350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:05.274844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 272/537] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:05 2022] GET /identity/v3/role_assignments?user.id=71f71f58204a4569bf6d937b6691c2f5&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:05.360592 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd866c-3a2b-473d-b4ec-0be868865b11 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.410175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.410812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.411115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.411396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.412064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:05.412373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.413824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.429180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 266/538] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:05.435164 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:05.495815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:05.557710 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dbc1-62bc-4b73-b561-fecd68ad7da5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.593550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.594191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.594469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.594744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.601813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.603303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:05.615736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:05.617785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:05.619914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 273/539] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:05.627130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:05.746745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:05.754251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ffbb8-24d6-4077-b8c3-d737a3b99e25 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.805634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.806272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.806553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.806828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.807585 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:05.807894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.810231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4cb2-1d0a-4a82-80b9-4d8602eaa970 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.824145 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 267/540] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:05.831123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:05.948423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1b68-16f8-474e-a793-0e10d01f4f45 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:05.959147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:05.973015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a2082-94f0-4657-aa06-35c0368c6308 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.973940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a2082-94f0-4657-aa06-35c0368c6308 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.974438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a2082-94f0-4657-aa06-35c0368c6308 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.977382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 268/541] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:05.981748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.982312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.982791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.984550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:05.985156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:05.985435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:05.985708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:05.986528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=4ee9e5824883448c9b52a0e292edf1e3) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:05.986837 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:05.993910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:05.994344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 274/542] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:05 2022] GET /identity/v3/role_assignments?user.id=4ee9e5824883448c9b52a0e292edf1e3&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:06.015568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:06.016758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:06.119248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 269/543] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:26:06.562654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:06.691270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fe21-a288-4c7d-9793-a7bf25bfdad5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:06.736771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:06.737630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:06.738059 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:06.738504 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:06.753697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:06.759066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:06.760124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:06.761093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:06.763494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 275/544] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:06.771120 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:06.898993 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:06.920007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1e1d2-5745-459e-8ec7-b8ada946defd None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:06.960282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:06.960900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:06.961181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:06.961452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:06.962126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:06.962427 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:06.963847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649079e-d708-49b3-9b4a-c195f1ab23f8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:06.973006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 270/545] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:06.978655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:06.997497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbda3-eabf-4ecb-8cb0-46239b4e7752 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:06.997497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbda3-eabf-4ecb-8cb0-46239b4e7752 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:06.998177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbda3-eabf-4ecb-8cb0-46239b4e7752 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:06.999434 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 271/546] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:07.006343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:07.006574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:07.006808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:07.031810 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:07.033325 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:07.034371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:07.119713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad9c85-cb2b-4e12-a62d-5ed35193c644 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:07.144241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 272/547] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:07.162637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:07.163228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:07.163513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:07.163785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:07.179739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:07.181224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:07.202552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:07.203490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:07.204302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:07.204302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:07.204302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:07.213943 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 276/548] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:07.218376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:07.343328 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:07.378796 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4043-44db-450f-832c-cdbe8f1ec5c8 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:07.421165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:07.422102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:07.422599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:07.423129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:07.424097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:07.424590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:07.426151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:07.440234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 273/549] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:07.445429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:07.445874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:07.609461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8c5e2-9387-4df8-bedd-b865a6b8f29e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:07.630947 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:07.656686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac752-5fc8-46ec-89f9-55891c3629f2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:07.672374 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:07.672939 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:07.673220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:07.673492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:07.678514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:07.685334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:07.691041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:07.698616 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:07.701581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 274/550] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:07.709171 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:07.731045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:07.733022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:07.733510 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:07.733983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:07.745112 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:07.748981 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:07.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:07.775639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:07.776735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:07.781283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 277/551] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:07.788132 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:07.864079 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48ca7f-ec34-41e9-b731-348f3f761a15 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:07.901784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:07.902395 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:07.902673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:07.902946 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:07.903927 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:07.904226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:07.905609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:07.924475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 275/552] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:07.932287 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:07.966631 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e15a6-5722-415d-9004-58172e3588fc None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.000162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.003356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.004115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.004392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.004708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.005522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:08.005833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.007281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c19bf-c798-46b8-b926-fa92f57da303 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.026751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 278/553] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 9 04:26:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:08.028867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a0aa-f8f0-4b39-bf59-0a2a8d85edb7 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.029164 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a0aa-f8f0-4b39-bf59-0a2a8d85edb7 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.029436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a0aa-f8f0-4b39-bf59-0a2a8d85edb7 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.035162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 279/554] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:08.036972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49a0aa-f8f0-4b39-bf59-0a2a8d85edb7 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.043066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.062803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3395d2-8b27-4a47-a460-08124ac31387 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.114214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.114874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.115206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.115729 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.128002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.129611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-05785248-7545-4cc0-83cc-1ed485c9522b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:08.147774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:08.148778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:08.149638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:08.149638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:08.149638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:08.154323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 276/555] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:08.155932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.156220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.156493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.174699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49a0aa-f8f0-4b39-bf59-0a2a8d85edb7 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.177315 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:08.178938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:08.219939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51feaff-4a02-4ecf-982e-565956000bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.221237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51feaff-4a02-4ecf-982e-565956000bab None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.221811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51feaff-4a02-4ecf-982e-565956000bab None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.222397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51feaff-4a02-4ecf-982e-565956000bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.272467 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 277/556] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:08.272467 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.318949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51feaff-4a02-4ecf-982e-565956000bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.320538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51feaff-4a02-4ecf-982e-565956000bab None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.324027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.329920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.407151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d44e-aca5-44fa-8bb6-50d80b68fbc8 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.437429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 280/557] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:08.438634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9617a-7d51-404b-b95d-563c7806b2b4 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.438918 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9617a-7d51-404b-b95d-563c7806b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.439207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9617a-7d51-404b-b95d-563c7806b2b4 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.440725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 281/558] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:08.444392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9617a-7d51-404b-b95d-563c7806b2b4 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.456588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.457203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.457480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.457861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.458511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:08.458811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.460338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37222c-d5f2-4307-a644-099f9db4639f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.472963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 278/559] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:08.474262 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.474550 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.474826 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.494950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:08.496228 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:08.571631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 279/560] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:08.572793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.589461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9617a-7d51-404b-b95d-563c7806b2b4 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.594329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.614166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.633456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.634643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.635026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.635418 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.647897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.649643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:08.668086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:08.669150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:08.670006 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:08.670006 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:08.670006 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:08.670626 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 282/561] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:08.671013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.690001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da375e99-1e83-482a-9aef-9cbacbcf111a None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.729006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.729626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.729911 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.730179 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.738203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.739704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-2672d673-396f-4694-bc58-2c59f320e67a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:08.752356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:08.753291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 280/562] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14149-adf7-4e48-a73f-a4f60a886ad6 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.759201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14149-adf7-4e48-a73f-a4f60a886ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.759900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14149-adf7-4e48-a73f-a4f60a886ad6 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.759900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 281/563] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:08.759900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14149-adf7-4e48-a73f-a4f60a886ad6 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.786039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997564ad-a6fa-41c2-9735-659bd0f32ce0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.822657 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.823308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.823591 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.823867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.834749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:08.840045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:08.841623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:08.842454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 283/564] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:08.843723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:08.858910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.862890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:08.870514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14149-adf7-4e48-a73f-a4f60a886ad6 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.904771 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.905372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.905645 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.905917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.906547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:08.906845 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.908259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7363-1b7f-410e-a77c-68fd8107c1aa None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:08.920293 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 282/565] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:08.921506 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.921790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.922060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.939577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:08.940838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:08.945846 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dce3a-e71f-42e9-b197-8d1d2a9dc9e6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:08.980381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:08.980992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:08.981861 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:08.982165 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:08.982853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:08.983182 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:08.984988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.001479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 284/566] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:26:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.002325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.011147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 283/567] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:09.011147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.088136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.093193 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.113910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c6660-b4a8-4ff0-9faf-2b9121be3ed7 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.116735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76381-2f8f-4034-98f2-33baf5bcc0b9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.148464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.149092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.149367 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.149638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.151680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.152314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.152555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.152830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.154018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:09.154318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.155725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.160769 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:09.168586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 285/568] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.168586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:09.168885 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:09.169733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:09.170535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.278354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e19d-1304-4c25-b4c2-c34b6b2f2494 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.282322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59da8e-cccf-4124-b22e-d68c26a0aff2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.312955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.313579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.313857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.314129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.316533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.316805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.317155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.317440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.317710 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.322061 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.323664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.326255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.328564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.330448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:09.335644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:09.336655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:09.337523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 286/570] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:09.337994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:09.349905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:09.350900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:09.351799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:09.351799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:09.351799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:09.351799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 285/571] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:09.352027 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.443485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e22b9-fd07-41f4-8d09-9ca10efd328d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.450471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790132e-6f52-4d4d-a76e-61e13275aff2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.478391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.479233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.479487 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.480077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.484449 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.485098 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.485330 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.485602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.486265 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:09.486569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.487999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.490664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.492117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.496126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.496934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:09.508944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:09.509911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:09.510777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:09.510777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:09.510777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:09.510777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:09.510777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.551837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.564018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.597007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1f057-cbae-490d-8941-a9cbfe6aa0d4 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.615952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c2b0-8ef5-440c-871d-c9a794f1ecee None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.630076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.630704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.630980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.631280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.641864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:09.647053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:09.648002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:09.648844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 287/574] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:09.649541 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.651852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.652461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.652743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.653020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.653738 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:09.654101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.655559 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.667456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 288/575] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.668232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.754997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e5847-ed76-44f4-ac0c-65213e5c0ff0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.766675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40956-ba3a-4bd5-bbe8-4ddb509bde6a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.769361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.776160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:09.790556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.791187 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.791467 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.791740 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.792376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:09.792674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.794407 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.801077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.801696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.801970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.802238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.806116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 288/576] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.806894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.813830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.815308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:09.829882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:09.830887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:09.831827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:09.831827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:09.831827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:09.831827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:09.831827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.906406 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2488a18-3da7-42ac-9c4f-9bbeffb815c2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.932075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0cfe1-0ad3-40f0-823c-714719e85a16 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:09.940512 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.941114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.941391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.941671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.942305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:09.942604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.944006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.955214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 289/578] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.955994 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.966702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:09.967339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:09.967631 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:09.967900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:09.968563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:09.968865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:09.970236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:09.978075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:09.978845 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:09.990031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.004416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.057309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e3d88-fc81-4181-8b42-43fec688ae2c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.079728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7f52-f92f-4813-983c-9ed64bddc118 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.091242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.091934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.092211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.092483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.093200 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=240b2bed570e4968a81057b1c9495353) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:10.093508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.094955 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.100353 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 290/580] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/role_assignments?user.id=240b2bed570e4968a81057b1c9495353&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:10.101116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.126095 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.126745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.127024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.127331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.134905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.136437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:10.154005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:10.154974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:10.155985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 291/581] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:10.157700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.234461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717677-89c1-4511-a257-c92d5e9ab841 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.236141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.261782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.271469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.272083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.272358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.272811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.273457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:10.273754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.275153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.283660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58524-5adc-49e7-8a05-594956256afa None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.289323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 291/582] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:10.290172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.324166 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.325705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.326006 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.326344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.334472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.335942 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:10.348347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:10.349301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:10.350227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 292/583] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:10.350806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.396046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241cb00-4176-4904-b70b-4d284d52345b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.430445 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.431080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.431404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.431720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.442847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.444333 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.458177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52241-29a5-4d61-b2dd-9e11e48bc9b2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:10.459366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:10.460297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:10.461202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:10.461202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:10.461202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:10.464966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 292/584] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:10.466370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.480953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.499727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.500336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.500618 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.500908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.501576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:10.501883 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.503363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.521108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 293/585] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:10.521108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.524134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.588965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891c702-1aa7-45bd-852e-2614aa311309 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.623714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.624339 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.624615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.624884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.627129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d306998-b64f-4153-81c9-58094f906ca4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.632418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.633854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:10.645301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:10.646241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:10.647184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:10.651023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 293/586] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:10.651884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.664088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.664691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.665114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.665393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.666120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:10.666431 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.667882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.686693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:10.687702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.731929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.755188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:10.769739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123696-9eaa-455f-bda9-3845379812b7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.801616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbda97-0757-4e67-b867-2ef9e190c0ad None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.805781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.806468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.806819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.807189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.807910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:10.808304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.810491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.823615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 294/588] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:10.824626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.839768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:10.840347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:10.840734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:10.841034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/d2fb8c8ee6324e4ba6c328a9c2450fde/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:10.855964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=d2fb8c8ee6324e4ba6c328a9c2450fde, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:10.858501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:10.874428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 295/589] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:10 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/d2fb8c8ee6324e4ba6c328a9c2450fde/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:10.875396 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:10.952576 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49081b8-14d9-46d1-b09d-90c39e5921c3 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:10.993715 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.002597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.003253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.003531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.003803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.004549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:11.004853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.006923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.023933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8e08d-c51b-4849-813c-8ba8af1e0fcd None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.034543 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 295/590] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:11.035858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.063803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.069526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.070154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.070435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.070719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.084440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.086370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:11.104424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:11.105374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:11.106282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:11.106282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:11.106282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:11.106282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 296/591] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:11.106501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.162781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10484d-984d-4ab0-9265-0c04b748cb70 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.220136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.221115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.221590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.222056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.235743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.237423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.238115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de92e7-f52e-4150-b8e4-40dc1a35d380 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:11.251289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:11.252275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 04:26:11.253197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:11.255454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 296/592] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:11.256430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.294029 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.295182 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.295476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.295748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.311359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.313094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.316743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:11.334827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:11.336077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:11.336955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:11.336955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:11.336955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:11.339169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 297/593] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:11.340315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.363554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.380637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5edaf-2752-4a04-ae45-f5650857d2d9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.423559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.424186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.424462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.424732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.425402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:11.425663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.427122 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.440355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 297/594] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:11.441251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.478533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5caec-e071-48cd-984f-e99206b3b986 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.526734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.527778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.529534 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.530286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.531267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:11.532045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.534063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.548689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271394-d5d1-4c90-99cd-a87d32e8da24 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.562953 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 298/595] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:11.562953 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.564682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.591791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.592394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.592668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.592937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.593632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:11.593928 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.595644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.612498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 298/596] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:11.612498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.666773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.711922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75947791-295f-4637-9426-9d4da37d90c6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.721712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dba55-8d0f-47c7-bc93-b9a8d58114f1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.759761 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.760550 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.760924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.761292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.763257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.764314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.764776 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.765623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.773692 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.774411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.775386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.776374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:11.790418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:11.791652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:11.792739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:11.792739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:11.792739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:11.793185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:11.794427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:11.795508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:11.800853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 299/597] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:11.800853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.802124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 299/598] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:11.803111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.825860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.915526 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa4402-641e-43dc-90b2-00887dbf539e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.921887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d089b14-b286-41d4-a777-f90a42542346 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:11.953528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.953815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:11.954582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.954998 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.955486 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.960786 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:11.961533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:11.961906 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:11.962271 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:11.963002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:11.963436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.964374 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:11.965166 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.966905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:11.979320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:11.980394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:11.981940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:11.988697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 300/599] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:11.989317 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 300/600] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:11.989990 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:11.990338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:12.079198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:12.100691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8793f-3a04-445a-88fc-0a884dc0aeee None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.102975 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23503-b006-41d3-9b74-75219e0bbbaf None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.136642 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.137820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.138288 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.138760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.139857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:12.140467 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.142561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.143579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.144280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.144649 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.144993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.145939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:12.146308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.147979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.159147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 301/601] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:12.160404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:12.168988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 301/602] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:12.168988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:12.239532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:12.272182 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f5be2-1ff8-480d-ba9c-97d100b7b1ba None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.296364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac6b05-f1b1-43fd-8906-3296b4cb7d48 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.307580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.308208 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.308489 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.308761 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.316256 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.317712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.320182 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:12.329623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:12.330508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 302/603] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:12.331605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:12.338162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067706e-4b94-4c36-a39d-aaca3f618130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.338801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067706e-4b94-4c36-a39d-aaca3f618130 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.339079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067706e-4b94-4c36-a39d-aaca3f618130 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.339377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067706e-4b94-4c36-a39d-aaca3f618130 None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/71f71f58204a4569bf6d937b6691c2f5/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.354685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067706e-4b94-4c36-a39d-aaca3f618130 None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=71f71f58204a4569bf6d937b6691c2f5, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.357143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067706e-4b94-4c36-a39d-aaca3f618130 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.379146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 302/604] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:12 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/71f71f58204a4569bf6d937b6691c2f5/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:12.379146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22bd7-b66a-408e-a8af-14742af8d6ee None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.379146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22bd7-b66a-408e-a8af-14742af8d6ee None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.379146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22bd7-b66a-408e-a8af-14742af8d6ee None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.380052 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 303/605] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:12.380993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22bd7-b66a-408e-a8af-14742af8d6ee None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:12.449502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8271c6-6f49-44bc-9f51-dcde908b1ec3 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.487220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce3aa9-5288-4ebc-b239-babd13c7695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.487829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce3aa9-5288-4ebc-b239-babd13c7695a None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.488107 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce3aa9-5288-4ebc-b239-babd13c7695a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.488379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce3aa9-5288-4ebc-b239-babd13c7695a None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/9f896dfbd2ad452e9def2c11cfa97e53/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.509908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce3aa9-5288-4ebc-b239-babd13c7695a None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=9f896dfbd2ad452e9def2c11cfa97e53, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.512070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce3aa9-5288-4ebc-b239-babd13c7695a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.533897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22bd7-b66a-408e-a8af-14742af8d6ee None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.539827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:12.540628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 303/606] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:12 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/9f896dfbd2ad452e9def2c11cfa97e53/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:12.544375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.544816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.545091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.579004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:12.581201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:12.606903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.607710 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.608039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.608367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.609147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:12.609459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.611204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.625961 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 304/607] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:12.632318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:12.657049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:12.707975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 304/608] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:12.753272 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0da6e-923a-40de-9b97-d962e8cc64bb None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:12.795740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c17c8-baa9-4269-a182-a880985917f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:12.796398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c17c8-baa9-4269-a182-a880985917f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:12.796671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c17c8-baa9-4269-a182-a880985917f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:12.796934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c17c8-baa9-4269-a182-a880985917f6 None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/4ee9e5824883448c9b52a0e292edf1e3/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:12.813131 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c17c8-baa9-4269-a182-a880985917f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=4ee9e5824883448c9b52a0e292edf1e3, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:12.814633 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c17c8-baa9-4269-a182-a880985917f6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:12.829481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 305/609] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:12 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/4ee9e5824883448c9b52a0e292edf1e3/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 04:26:13.067724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:13.180940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687efb-77c1-45ce-a16e-fe43b8d446dd None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:13.223167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:13.223822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:13.224098 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:13.224362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:13.239127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:13.248627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:13.249572 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:13.250382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 305/610] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:13.253255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81ef9c-2e59-4afe-8fe1-d7d34313c91b None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:13.253547 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81ef9c-2e59-4afe-8fe1-d7d34313c91b None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:13.253825 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81ef9c-2e59-4afe-8fe1-d7d34313c91b None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:13.255761 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:13.259344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 306/611] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:13.260939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:13.261220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:13.261494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:13.291875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:13.297037 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:13.308432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:13.336956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:13.451212 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 307/612] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:13.477326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29378ba-def5-4f34-91cd-68bd44f50014 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:13.540261 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:13.540882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:13.541164 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:13.541436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:13.542165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:13.542469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:13.544201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:13.557554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 306/613] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:13.563961 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:13.681841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f9ec5-e8ed-49b4-8611-2a9146a80d5f None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:13.733577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:13.734234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:13.734515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:13.734785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:13.745880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:13.747454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:13.753505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:13.771818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:13.772796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:13.774668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:13.774668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:13.774668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:13.774668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 308/614] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:13.780161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:13.800581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:13.950185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e74e8a-5942-4d39-8b43-b16bd26e94a4 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:13.952794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:13.987068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f3a9d-5b66-4d2a-a250-d68001a9007f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.016155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.016766 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.017050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.017321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.017966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:14.018263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:14.019678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:14.039340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 307/615] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:14.042561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.048320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.048955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.049230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.049499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.071923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:14.077708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:14.078734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:14.079959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 309/616] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:14.092477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.171479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:14.214116 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013e97-0342-4e60-bbe5-8c9397db6db2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.257318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27e15-6522-4571-8cf5-576da7c616de None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.271845 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.272450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.272723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.272989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.273656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:14.273952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:14.275336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:14.291114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 310/617] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:14.297361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.345343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.346026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.346263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.346540 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.364219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:14.365693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:14.390933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:14.391960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:14.392918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 308/618] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:14.399940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.413533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257510-03e4-4a10-9926-61bf6b8fb25e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.431874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:14.458217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.458853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.459146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.459415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.463796 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:14.481845 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:14.483810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:14.515034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:14.516223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:14.517115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:14.517115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:14.517115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:14.517115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 311/619] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:14.523556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.601873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd664017-9611-4ecf-888e-9473fc4a8420 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.660801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.663901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.664418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.664892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.665843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:14.667327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:14.669527 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:14.696494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 309/620] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:14.703669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.719617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515cf8e-d74b-4654-be96-0ad8a02cacf4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.767080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.768533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.769029 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.769512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:14.770358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:14.770874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:14.772529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:14.786478 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 312/621] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:14.792298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:14.849396 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:14.860841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:14.900416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3216663-e181-49b0-9fbd-9761f7074f57 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.956980 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bdb7b-6dab-413d-ad43-5637dbd88cc2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:14.974242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:14.975254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:14.975728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:14.976893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.004036 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.005520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.020050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.021011 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.021498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.022557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-63069377-da10-4dd7-9a7d-aa56b1ecc3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:15.029028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:15.030048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:15.030937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:15.030937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:15.030937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:15.030937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 310/622] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:15.031787 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4785c-fff5-4f6a-b326-203465542fc4 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.032071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4785c-fff5-4f6a-b326-203465542fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.032343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4785c-fff5-4f6a-b326-203465542fc4 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.038072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 311/623] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:15.038660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.039034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4785c-fff5-4f6a-b326-203465542fc4 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.040831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b2f70e16-a20f-45ff-9776-fca01511eea8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:15.059629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:15.060712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:15.061656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:15.064797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 313/624] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:26:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:15.070763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.070763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.070763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.095005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:15.097060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:15.163591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4785c-fff5-4f6a-b326-203465542fc4 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.185682 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 314/625] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:15.191323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.203054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.207865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.210722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.211574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.212034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.212451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.213299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:15.213752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.215494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da4140-5857-4890-8df8-add971d240d0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.233669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 312/626] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:15.235930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a811b2-bb38-4a14-870b-2525bdfb1c57 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.236375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a811b2-bb38-4a14-870b-2525bdfb1c57 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.236805 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a811b2-bb38-4a14-870b-2525bdfb1c57 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.243199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 313/627] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:15.244173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a811b2-bb38-4a14-870b-2525bdfb1c57 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.305481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0105b-da93-4c2a-a080-485a9f93528a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.341745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.342511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.342884 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.343296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.344115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:15.344575 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.346439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a104d3-0b19-48ce-a865-8366906a2b95 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.365338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 315/628] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:15.370984 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.371383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.371851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.377736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a811b2-bb38-4a14-870b-2525bdfb1c57 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.391358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:15.392823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:15.419823 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.420648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.421023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.421416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.428308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.429859 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:15.442377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:15.443614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:15.444695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:15.446187 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 314/629] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:15.447153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.482155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 316/630] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:15.483040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.493664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.539498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.575067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8614c9e-0044-426b-adb4-b68d84821980 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.603592 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a27a31-ed6c-4c5b-807d-72f71f6e0b6f None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.618703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732731d-e862-4238-8058-c92ccfe4d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.619352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732731d-e862-4238-8058-c92ccfe4d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.619630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732731d-e862-4238-8058-c92ccfe4d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.619887 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732731d-e862-4238-8058-c92ccfe4d9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.641437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.642046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.642327 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.642598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.643315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:15.643620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.645034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.657901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 317/631] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:15.658688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.700755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732731d-e862-4238-8058-c92ccfe4d9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.702496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732731d-e862-4238-8058-c92ccfe4d9d3 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.728434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.767993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75ff4-7753-40a1-a5ba-8dba984e0f6c None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.769655 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.802318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.802938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.803246 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.803524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.814089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:15.817233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 315/632] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:15.818471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec41f3-1710-4bed-8ec0-0d19db9eb1cb None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.818751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec41f3-1710-4bed-8ec0-0d19db9eb1cb None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.819017 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec41f3-1710-4bed-8ec0-0d19db9eb1cb None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:15.819331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:15.820198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:15.821615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:15.822245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 316/633] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:15.822245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec41f3-1710-4bed-8ec0-0d19db9eb1cb None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.825881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 318/634] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:15.826703 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.923774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a334b4-5f7b-49ab-9497-b7cdcdf663c0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.925251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec41f3-1710-4bed-8ec0-0d19db9eb1cb None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:15.948910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:15.958371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.958861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:15.958993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.959277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.959538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:15.959642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.959819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:15.960088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/240b2bed570e4968a81057b1c9495353/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:15.969602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:15.973892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=240b2bed570e4968a81057b1c9495353, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:15.975345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:15.975671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:15.976699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 319/635] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:15.977539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.990152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 317/636] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:15 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/240b2bed570e4968a81057b1c9495353/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:15.990946 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:15.993411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.102720 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a6b9-827f-455d-8ef9-cb40f48a1c8b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.108575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e555-c592-44de-afdf-2157fe811400 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.143307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.144342 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.144836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.145338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.145519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.146122 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.146397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.146658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.147362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:16.147660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.149063 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027661-dec0-4cf9-971f-1e2dd020ea0e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.158387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 318/637] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:16.159775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d87f-1887-463d-a655-005b6510f56d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.160050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d87f-1887-463d-a655-005b6510f56d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.160323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d87f-1887-463d-a655-005b6510f56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.164304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.165983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.180734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d555d87f-1887-463d-a655-005b6510f56d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:16.181925 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d555d87f-1887-463d-a655-005b6510f56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:16.185520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:16.186475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:16.187896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:16.187896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:16.187896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:16.187896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 320/638] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:16.188297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.246158 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.251984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.271118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 319/639] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:16.271118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555d87f-1887-463d-a655-005b6510f56d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.321858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be383f-4680-492d-9851-ac549badb0aa None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.358355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.358985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.359382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.359662 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.360327 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:16.360627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.361998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.375221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 321/640] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:16.376110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.388094 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555d87f-1887-463d-a655-005b6510f56d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.437689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.438568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.438989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.439542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.453614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.455065 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:16.475131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:16.476128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:16.477005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:16.477005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:16.477005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:16.479280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 320/641] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:16.480412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.504101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.508615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1549-b21c-46ea-ae83-6b738340b8ce None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.547015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.548142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.548469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.548949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.549877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.551184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:16.551690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.553289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.567383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 322/642] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:16.568711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.615359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71207-74c9-49f4-9a94-a46fc782aecb None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.651167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.651810 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.652087 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.652358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.663105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.664576 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:16.680067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:16.681146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:16.687153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:16.687153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:16.687153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:16.687379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03ebe2-043a-46c9-85e9-61ae5005aa19 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.687456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 321/643] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:16.687456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.722587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.723392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.723669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.724755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.725409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:16.725714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.727104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.740695 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 323/644] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:16.741566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.765792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.794609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:16.798835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54f56-5d4f-47e5-b3f2-4a5015ac035c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.833830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.834466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.834748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.835024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.844401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:16.846155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:16.858707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53aa1-04fd-4cb8-8fa8-0d60d0236b33 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:16.859350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:16.860166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 322/645] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:16.861204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.900870 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:16.901425 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:16.901706 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:16.901972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:16.912477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:16.917678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:16.919286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:16.920299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 324/646] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:16.920997 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:16.973349 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755129-05da-4c17-b86e-718a4dd8ee2f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.009224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.009828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.010108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.010379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.010664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.011012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.011627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.012842 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.030188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 323/647] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.030188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.036949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81733-39a9-4dd5-a5de-c8f697245b7d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.052629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.074443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.075233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.075519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.075798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.083447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.084913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:17.096792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:17.097714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 325/648] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:17.098654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.141871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef9ff-c106-4ddc-83cb-6dc9f06ac570 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.178815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.179374 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.179652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.179921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.180611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.180913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.182344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.194843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 324/649] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.198041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.209970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd232-3294-4e37-96d2-c543c0c2e045 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.247724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.248336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.248613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.248883 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.249536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.249843 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.251246 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.263998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 326/650] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.263998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.263998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.297836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.323396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05dd23-0c81-4a62-8e0e-b26cd4eef245 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.362242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.363712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.364209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.364810 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.368191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112843fe-097b-4b39-9172-196e13e5d7b6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.374671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.376809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:17.392396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:17.393934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:17.395085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:17.395931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 325/651] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:17.396401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.408301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.408923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.409207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.409478 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.410581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.410890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.412681 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.431349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 327/652] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.432080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.494537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.509894 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47109b2-162a-4f59-8d8b-a3cca526ec10 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.540371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973484a5-f4d0-4105-837d-7a524a58dca0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.547013 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.547860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.548362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.548642 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.549654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=d2fb8c8ee6324e4ba6c328a9c2450fde) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.549970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.551858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.558326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 326/653] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/role_assignments?user.id=d2fb8c8ee6324e4ba6c328a9c2450fde&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.558326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.571943 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.593280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.594114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.594468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.594848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.610734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.612644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:17.633476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:17.634479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:17.635416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:17.635416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:17.635416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:17.639268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 328/654] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:17.640472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.722887 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0b036-e85f-42f2-a748-18f7d8a72c64 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.765379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.766000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.766276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.766552 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.767345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.767651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.770002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.780799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7713e-5f8c-46e3-8132-c35c296463c2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.795884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 327/655] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.796067 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.796675 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:17.829330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.830120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.830495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.830867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.876843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:17.919798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.921993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.930333 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a04fe-95bb-4b1e-a611-800e2102a1c5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:17.976130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:17.976809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:17.977188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:17.977559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:17.978753 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:17.979185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:17.981618 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:17.997553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 328/656] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:17.998400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.047158 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 329/657] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:18.048159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.064602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.141988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4817d-b14a-4b68-904a-2ed2bb94ca23 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.168115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.169058 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47dd98-00a0-43f9-89cd-82f34794268a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.186661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f6da-1462-4c53-bbde-fe51596b9145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.187483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f6da-1462-4c53-bbde-fe51596b9145 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.187891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f6da-1462-4c53-bbde-fe51596b9145 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.188247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f6da-1462-4c53-bbde-fe51596b9145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.216487 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.217582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.218187 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.218471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.226575 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.227978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:18.242550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:18.243693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 04:26:18.244833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:18.249276 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 330/658] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:18.249541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.270149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f6da-1462-4c53-bbde-fe51596b9145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.271669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f6da-1462-4c53-bbde-fe51596b9145 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.323550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.356153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56adae1-4954-4271-9f06-a7893e2cc93e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.376492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 329/659] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:18.378216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e499d-e267-4100-8bd3-ce0240cfa2a2 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.378505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e499d-e267-4100-8bd3-ce0240cfa2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.378781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e499d-e267-4100-8bd3-ce0240cfa2a2 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.383131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 330/660] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:18.383131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e499d-e267-4100-8bd3-ce0240cfa2a2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.397277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.398073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.398253 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.398512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.405179 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.413017 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.414656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:18.430650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:18.431852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:18.432775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:18.432775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:18.432775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:18.435704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 331/661] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:18.436078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.495974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e499d-e267-4100-8bd3-ce0240cfa2a2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.531940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.532550 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.532833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.533094 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.533825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:18.534135 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.535619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1204e04-9de5-49f9-ab39-157634deb896 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.544374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b31a3d-9fbd-4f8c-8568-dce12dda6a5e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.553422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 331/662] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:18.554525 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.554817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.555117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.573696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.575063 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:18.576332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:18.586667 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.587356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.587637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.588004 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.600243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.601696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:18.616079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:18.617066 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:18.617951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:18.617951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:18.617951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:18.622248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 332/663] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:18.623078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.659263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 332/664] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:18.659263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.668215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.736814 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17e4b-f2fb-4a0e-b976-d789b5a5ad88 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.775714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.776557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.776975 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.777392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.778973 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:18.779323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef654d5-76ec-4188-bfb6-bddc441b14a2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.779629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.781297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.799459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 333/665] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:18.800541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:18.820475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.821345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.821899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.822334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.841954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.912380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.914211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.922996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ec7a-40e4-4d9c-bd36-625a585aade3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:18.925303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:18.960614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:18.961231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:18.961512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:18.961787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:18.962432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:18.962737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:18.964138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:18.975556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 334/666] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:18.976360 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.034050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 333/667] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:19.034657 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.079027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.086171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6d54-8b09-430d-950b-7ec61a45e53f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.121705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.122432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.122771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.123125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.129688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.131234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.139413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2606-87b3-44a8-bd09-2f2ac039556f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:19.142759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:19.143857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:19.144976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:19.145779 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 335/668] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:19.146551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.155863 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.181239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.182016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.182397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.182773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.193269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:19.198242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:19.199397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:19.201168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:19.203413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 334/669] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:19.203413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.268549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264fab-846b-4913-adcc-d229f39e3d85 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.303716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.304368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.304656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.304932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.312637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643c67-b351-479a-929a-2b05fbe48bd2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.312787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.314128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:19.326134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:19.327021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:19.327920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 336/670] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:19.328399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.348547 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.353845 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.354482 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.354756 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.355023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.365817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.367597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:19.383496 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:19.384574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:19.385547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:19.385547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:19.385547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:19.385718 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 335/671] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:19.386468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.409789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.444426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b74de-b22a-4037-982d-d57090604dcf None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.485178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.485889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.486185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.486439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.487207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:19.487505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.488991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.493413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421eaf-bedc-4580-b8e6-a306642e44ed None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.505550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 337/672] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:19.506907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.529777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.530400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.530682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.530988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.531705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:19.532002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.533398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.541612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 336/673] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:19.542402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.598654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.625603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29a5cf-44fc-4c4d-8469-8986d9972a06 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.630151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.649881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e2532-0222-4e4c-b4a0-cfe66a69a8d1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.661294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.661897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.662177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.662433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.663130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:19.663435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.664836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.681945 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 338/674] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:19.681945 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.692236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.692847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.693129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.693403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.694047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:19.694349 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.695749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.712430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 337/675] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:19.712430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.797790 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321976f5-1ca2-49e7-99d9-21d761224bf3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.819194 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d861b-97c3-4474-90d3-2ece65ebb127 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:19.837620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.838225 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.838505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.838775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.839531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=71f71f58204a4569bf6d937b6691c2f5) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:19.839835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.841432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.844231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.855272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:19.856451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:19.856837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:19.856997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:19.857153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 339/676] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/role_assignments?user.id=71f71f58204a4569bf6d937b6691c2f5&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:19.858468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.868878 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:19.870372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:19.873037 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:19.889452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:19.890477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:19.891422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:19.891422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:19.891422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:19.895449 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 338/677] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:19.896424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:19.986355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29824b-6b00-4178-8fa5-c79c930ce2f3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.010121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed1ab-c381-419d-83ab-663ab798e27e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.025569 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.026293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.026573 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.026842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.027602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=9f896dfbd2ad452e9def2c11cfa97e53) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:20.028501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.031140 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.037960 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 340/678] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/role_assignments?user.id=9f896dfbd2ad452e9def2c11cfa97e53&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:20.039033 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.057554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.058209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.058491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.058759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.067128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.068635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-f5b8a81d-5cc3-44d9-9452-5aa43dfd6d04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:20.081555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:20.082724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:20.083886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:20.088216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 339/679] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:20.089173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d245-d5cb-414c-a5af-0e101713d9f9 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.089461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d245-d5cb-414c-a5af-0e101713d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.089743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d245-d5cb-414c-a5af-0e101713d9f9 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.092603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 340/680] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:20.093391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d245-d5cb-414c-a5af-0e101713d9f9 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.147853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:20.172493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:20.214204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d966ce9-6932-46b1-988f-b5402c110c9a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.241147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d245-d5cb-414c-a5af-0e101713d9f9 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.264079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.264927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.265041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.265222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.265866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:20.266163 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.268574 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f645b-0d24-419c-b5dd-64557d6cb5a0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.282713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 341/681] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:20.284405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.284920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.285393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.288785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.289407 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.289690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.289964 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.290670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:20.290979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.293926 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.304719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:20.305933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:20.308016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 341/682] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:20.310696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.396357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 342/683] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:20.397215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.445072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000aa0e-b64b-4b02-8988-6a6654a69cc0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.460342 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:20.469707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:20.484264 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.484914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.485191 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.485490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.493440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.494976 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:20.507558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:20.508734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:20.509825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 342/684] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:20.515658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.531030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98209a25-37f4-4c35-820e-43fbc6cc1b50 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.575174 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.576143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.576603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.577074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.578192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=4ee9e5824883448c9b52a0e292edf1e3) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:20.578653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.580674 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.592611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 343/685] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/role_assignments?user.id=4ee9e5824883448c9b52a0e292edf1e3&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:20.632892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43e989-ac91-40e9-93b5-5fe94a9a3fb8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.674066 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.674941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.675398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.675846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.676755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:20.677216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.678902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:20.702009 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 343/686] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:20.707260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.852958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f78a-cb77-4b0e-95ec-9867412042ff None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:20.858030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:20.874449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:20.901009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:20.901637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:20.901919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:20.902193 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:20.930139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:20.990772 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:20.993592 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:21.012758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7235-9449-426f-99d1-89864d434e66 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.079857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.080685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.081086 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.081456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.097759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:21.102801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:21.103959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:21.104975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:21.112189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 344/687] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:21.113556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.114660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 344/688] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:21.120241 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.142434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:21.211902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:21.224706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610e6d-f0dd-47ab-bf6f-0c2d13e0057f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.261345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d78e-74db-4280-ad18-28054acdaff2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.275212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.275936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.276284 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.276624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.277383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:21.277803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:21.279357 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:21.295301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 345/689] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:21.298060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.346276 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.346923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.349168 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.349452 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.369772 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:21.372872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:21.400597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:21.401582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:21.402467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:21.402467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:21.402467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:21.404554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 345/690] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:21.410685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.490077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40152643-633d-49d5-bb80-4c8300371ec0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.532956 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:21.553257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.555022 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.558181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.558665 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.577967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:21.580441 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:21.583700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c1615-811a-4825-887b-ccbb66a165ea None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:21.607010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:21.607997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:21.608962 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:21.608962 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:21.608962 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:21.611010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 346/691] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:21.617204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.635524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:21.661449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.662412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.662900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.663416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.665289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:21.665842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:21.667623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:21.694514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 346/692] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:21.703660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.786451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef307c-f240-4f74-b130-c4ab7bcea74d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.835735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.836347 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.836625 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.836897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.837539 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:21.837838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:21.839233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:21.867352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 347/693] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:21.876257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:21.898019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743317-ca56-416e-a09c-90ca681f5565 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:21.960754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:21.982525 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:21.983277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:21.983558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:21.983825 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:21.995579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:21.997576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:21.999046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:22.011656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:22.013180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:22.014055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:22.014483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 347/694] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:22.020175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:22.058450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a55a-046a-43d0-998f-30d55fe5b675 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:22.132987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:22.133663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.133942 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.134210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.145886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:22.147363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:22.164910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797db50-f4f5-4f42-8a59-3e09ef37b759 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:22.176498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:22.177458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:22.178391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 348/695] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:26:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:22.183372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:22.206850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:22.207872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.208466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.208972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.209890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:22.210507 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:22.212178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:22.226073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 348/696] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:22.237535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:22.357514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35802a-3345-43ca-8be3-ad2129d7f945 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:22.384651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:22.388652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:22.399850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:22.401207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.402013 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.402483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.404483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:22.405142 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:22.406813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffe3a6-93ea-40c2-855a-a056a351e807 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:22.426976 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 349/697] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:26:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:22.428604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30bcbf-6762-4ea5-aaf7-12efe62f682c None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.429033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30bcbf-6762-4ea5-aaf7-12efe62f682c None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.429448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30bcbf-6762-4ea5-aaf7-12efe62f682c None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.431144 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 350/698] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:22.433643 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30bcbf-6762-4ea5-aaf7-12efe62f682c None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:22.469382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85963a07-9bea-4c69-8a87-2a23062d470e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:22.511275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:22.511961 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.512737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.513008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.514636 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=240b2bed570e4968a81057b1c9495353) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:22.514950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:22.516432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e813d-4696-45fb-8b29-6b5898f720ba None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:22.531304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 349/699] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:22 2022] GET /identity/v3/role_assignments?user.id=240b2bed570e4968a81057b1c9495353&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:22.532767 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c60e-111d-48e1-83da-976c4bfeb04c None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.533056 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c60e-111d-48e1-83da-976c4bfeb04c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.533328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c60e-111d-48e1-83da-976c4bfeb04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.553697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30bcbf-6762-4ea5-aaf7-12efe62f682c None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:22.571793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3dc2c60e-111d-48e1-83da-976c4bfeb04c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:22.573023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3dc2c60e-111d-48e1-83da-976c4bfeb04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:22.596231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:22.597305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.597834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.598331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.724972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:22.729855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 350/700] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:22.748494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:22.750170 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:22.762729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903dfeb-d1c2-415c-8026-b6f0690bc6cc None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.763075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903dfeb-d1c2-415c-8026-b6f0690bc6cc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.763313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903dfeb-d1c2-415c-8026-b6f0690bc6cc None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.764977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 351/701] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:26:22.771648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:22.771648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:22.772774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:22.794555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:22.795333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:22.854485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:22.895154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 352/702] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:26:22.897164 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 351/703] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 04:26:22.904304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.017216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129225a-5b33-49dc-93e3-ddeb999a41d8 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.050400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.056308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.056957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.057239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.057512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.073017 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.074521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:23.091914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:23.093007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:23.093894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:23.093894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:23.093894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:23.097414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 353/704] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:23.099034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.130648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.153774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.172067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a175d1-4535-43c6-9fb6-787cc0f33601 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.207399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.208029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.208304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.208573 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.221581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74101207-b05a-4e25-888c-7732f7bed47c None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.225822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.227187 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:23.245531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:23.247069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:23.248781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:23.248781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:23.248781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:23.248781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 352/705] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:23.253267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.261927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.262558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.262960 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.263290 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.263936 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:23.264240 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.265722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.285464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 354/706] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:23.286530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.363267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebdef-52fa-4534-a794-5d16a44a8962 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.391663 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.399432 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.400012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004e10d-630f-4076-ac16-eb3383e85479 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.400187 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.400335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.400571 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.401207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:23.401509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.403650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.406129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.417514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 353/707] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:23.423133 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.437780 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.438688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.439185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.439636 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.440421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.441972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-8022a8b3-377a-4dcd-97f8-0df30ed636f3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:23.453954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:23.454991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:23.456068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:23.458441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 355/708] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:23.459854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fcf06-ac33-4433-8432-36601bd44321 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.460133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fcf06-ac33-4433-8432-36601bd44321 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.460403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fcf06-ac33-4433-8432-36601bd44321 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.463214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 356/709] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:23.463214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fcf06-ac33-4433-8432-36601bd44321 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.533668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976dd86-df42-4c60-bb21-4530ba8b0232 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.571150 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.571760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.571971 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.572242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.577467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fcf06-ac33-4433-8432-36601bd44321 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.579046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.580593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:23.594155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:23.595267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:23.596362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:23.597049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 354/710] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:23.602633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.618014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32497d-1052-4655-99d8-c8171484a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.618623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32497d-1052-4655-99d8-c8171484a836 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.618902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32497d-1052-4655-99d8-c8171484a836 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.619205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32497d-1052-4655-99d8-c8171484a836 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.619850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32497d-1052-4655-99d8-c8171484a836 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.621335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32497d-1052-4655-99d8-c8171484a836 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.652849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 357/711] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:26:23 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:23.652849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.652849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.652849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.661113 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.668609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:23.670545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:23.678838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.736502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eacab-463d-4143-aacb-5726c56149da None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.759553 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 358/712] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:23.760732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.805336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.805980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.806263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.806538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.807230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:23.807539 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.813354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.829078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 355/713] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:23.839006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:23.928907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f357b-2491-461f-b14e-353a788b33b2 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.966424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6f34a-ca84-458f-b440-930c2f87bb4d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:23.972323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:23.973372 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:23.973831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:23.974307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:23.975822 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:23.976353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:23.978358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:23.982941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.991503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:23.997480 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 359/714] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:24.003933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:24.010379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:24.011005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:24.011312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:24.011592 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:24.012551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:24.012920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:24.014367 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:24.023394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 356/715] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 9 04:26:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:24.092731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:24.141127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c4186-4233-41b7-8607-ffa2d3649ed2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:24.189043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:24.189928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:24.191231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:24.191770 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:24.194082 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=d2fb8c8ee6324e4ba6c328a9c2450fde) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:24.195507 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:24.197135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:24.208551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 360/716] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:24 2022] GET /identity/v3/role_assignments?user.id=d2fb8c8ee6324e4ba6c328a9c2450fde&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:24.252144 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c167e-ccfe-4244-9520-414a580a84ec None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:24.289963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:24.290922 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:24.291377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:24.291825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] PATH_INFO: `/v3/services/network` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:24.292573 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:24.294870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:24.307634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:24.309002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:24.310292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:24.317470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 357/717] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:24 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:24.319175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:24.399587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:24.439423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f20c49-dc4c-4ee4-81c9-dfc6d0f9becc None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:24.475485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:24.476343 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:24.476771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:24.477190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:24.477991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] RBAC: Adding query filter params (name=network) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:24.478439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:24.479976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134256cd-966a-4c75-b5d9-155663e68c69 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:24.489876 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 361/718] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:24.491451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:24.545430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:24.613926 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65970297-04c3-4ca8-b786-cd23f628cc18 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:24.658698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:24.659698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:24.660175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:24.660655 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:24.661486 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] RBAC: Adding query filter params (type=network) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:24.661978 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:24.663587 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074e6e-ad6d-4023-be3d-cdf8298f3e0c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:24.669290 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 358/719] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:25.358063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f5df-a203-44b8-b3a8-64df5b445942 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:25.358584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f5df-a203-44b8-b3a8-64df5b445942 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:25.358584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f5df-a203-44b8-b3a8-64df5b445942 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:25.360289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 362/720] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:25.366273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:25.366615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:25.366817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:25.390982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:25.392196 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:25.476492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 359/721] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:25.804821 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f5df-a203-44b8-b3a8-64df5b445942 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:25.949036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f5df-a203-44b8-b3a8-64df5b445942 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:25.980041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:25.998931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:25.999924 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.000433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.000922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.018485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:26.024034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:26.024951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:26.025774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:26.028734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 363/722] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:26.036200 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:26.103239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:26.164611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedb8c4-6fa2-406a-88f6-39520adcbbc2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:26.206520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:26.207155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.207435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.207704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.208369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:26.208663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:26.210038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:26.228984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 360/723] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:26.235247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:26.393620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6799-3172-4d3c-969c-bcdd28310ac7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:26.428451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:26.429079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.429356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.429629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.440908 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:26.442365 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:26.457860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:26.458813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:26.459818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:26.459818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:26.459818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:26.459818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 364/724] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:26.464457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:26.623947 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2527-9785-4f32-b25f-f87726d86aaa None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:26.632240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:26.681494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:26.682048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.682413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.682698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.683413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:26.683844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:26.685573 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ce464-0d4c-4f09-9778-4e097edc1e70 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:26.708561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 361/725] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:26.713708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:26.764364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:26.800374 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6cb0a-3560-4716-b5d0-1e66410e0bbe None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.800898 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6cb0a-3560-4716-b5d0-1e66410e0bbe None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.801325 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6cb0a-3560-4716-b5d0-1e66410e0bbe None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.807141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 362/726] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:26.808567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6957cd-180d-46b0-a79b-7d790795d3cd None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.809835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6957cd-180d-46b0-a79b-7d790795d3cd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.810480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6957cd-180d-46b0-a79b-7d790795d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.829339 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-bd6957cd-180d-46b0-a79b-7d790795d3cd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:26.830884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-bd6957cd-180d-46b0-a79b-7d790795d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:26.838041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcff5c-f18f-458b-a32a-bd9543cda038 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:26.874250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:26.874995 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.875354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.875624 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.884882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:26.886551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-0d4db93e-06aa-457f-bd4d-e2bc685ee8c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:26.900440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:26.901473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:26.903072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 365/727] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:26.904459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea45c-1c81-427a-b532-23deb202bb5e None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.904459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea45c-1c81-427a-b532-23deb202bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.904459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea45c-1c81-427a-b532-23deb202bb5e None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.905807 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 366/728] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:26.910651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea45c-1c81-427a-b532-23deb202bb5e None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:26.930053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 363/729] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:26.932123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663dbc3-d9eb-4f25-b9f6-811cc8f82239 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:26.933009 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663dbc3-d9eb-4f25-b9f6-811cc8f82239 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:26.933533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663dbc3-d9eb-4f25-b9f6-811cc8f82239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:26.959254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d663dbc3-d9eb-4f25-b9f6-811cc8f82239 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:26.961438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d663dbc3-d9eb-4f25-b9f6-811cc8f82239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:27.044668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.052184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea45c-1c81-427a-b532-23deb202bb5e None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:27.066425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 364/730] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:27.067772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1bc1a-c65f-4ada-b163-66e683a4cf7e None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.068061 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1bc1a-c65f-4ada-b163-66e683a4cf7e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.068334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1bc1a-c65f-4ada-b163-66e683a4cf7e None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.073726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 365/731] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:27.075167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.075455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.075826 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.095301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:27.096480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:27.108764 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:27.109381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.109656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.109927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.110800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:27.111123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:27.112725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:27.115254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.146766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 367/732] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 9 04:26:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:27.151209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.174708 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 366/733] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 04:26:27.239902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.299316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d318b6-be26-4f7c-a57a-9a72eae44b4d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:27.341142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:27.341746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.342027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.342299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.378398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.425271 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:27.427285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:27.454855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e049-9340-47b6-bdc4-90f0333ecd56 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:27.518003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:27.518549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.518828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.519113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.519841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:27.521279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:27.539603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 368/734] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 04:26:27.540769 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 367/735] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:26:27 2022] POST /identity/v3/services => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:27.541895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.547200 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.564799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.627412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.679414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705501-bda0-4933-849d-dc07ac8b1b60 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:27.682770 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98765c-6d5e-46b7-91ca-6029d2f1fa93 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:27.717941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:27.718580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.718914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.719149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.722906 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e769-1f8c-4b5c-8e8f-ab79600d6a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:27.723563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e769-1f8c-4b5c-8e8f-ab79600d6a81 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.723841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e769-1f8c-4b5c-8e8f-ab79600d6a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.724811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e769-1f8c-4b5c-8e8f-ab79600d6a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.730414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:27.736120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e769-1f8c-4b5c-8e8f-ab79600d6a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:27.736248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:27.737128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:27.737989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 368/736] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:27.738668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-dfc1e769-1f8c-4b5c-8e8f-ab79600d6a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:27.744517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:27.745723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 369/737] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:27.748020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd808-6323-4673-bbaa-347e4958ca4b None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.749490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd808-6323-4673-bbaa-347e4958ca4b None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.749490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd808-6323-4673-bbaa-347e4958ca4b None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.750076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 370/738] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:27.755491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.756314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.756314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.774736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:27.775904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:27.825469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.845482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 371/739] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 04:26:27.856287 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.863282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a4d5-833e-49dd-acae-dfad19059492 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:27.909578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:27.910202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:27.910477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:27.910744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:27.922751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:27.923770 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:27.924546 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:27.941398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:27.942392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:27.943308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:27.943308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:27.943308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:27.943308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 369/740] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:27.944224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:27.988905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12bc67-30b3-46a7-8fc4-c84295650525 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.025536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.026509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.027009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.027719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.028604 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:28.029110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.030736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.039880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 372/741] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:28.041034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.053670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd8113-0e94-443f-9cfe-6be05e1cb47c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.078549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.092015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.092622 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.092922 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.093172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.093834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:28.094128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.095545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.109286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 370/742] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:28.110185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.159645 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffe66-923b-499b-b65e-b2db43ce1a21 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.167375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.197109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.197715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.198002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.198274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.198914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:28.199862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.201267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.212770 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 373/743] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:28.213570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.225566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3c63-7e99-4373-94cb-6a11023d4f0a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.264897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.265529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.265809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.266076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.276615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.278307 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:28.292759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:28.293893 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:28.294777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:28.294777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:28.294777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:28.294777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 371/744] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:28.294777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.333969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.335713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951fc1-3425-4a1f-85db-ea8b45594c29 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.370590 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.372206 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.373156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.373156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.384222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.385669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:28.403628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:28.404585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:28.405448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:28.405448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:28.405448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:28.405448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 374/745] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:28.406170 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.408366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bab50d-e051-434e-a15b-6778160ec3c8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.430155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.443959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.444570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.444852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.445123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.445774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.447188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.462576 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 372/746] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:26:28 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:28.463441 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.560007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ae07-b244-4cd2-9919-aeb61eb0486f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.583607 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.598706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625d321-3179-49b1-a764-4e2cb03fb543 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.615537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.616957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.617641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.618060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.628708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.631223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.640059 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.640875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.641252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.641626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.642376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:28.642776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.644370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:28.647323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:28.648201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:28.649069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 375/747] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:28.649541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.663043 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 373/748] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:28.663979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.760349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.775399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe012e1-0fa7-4f76-987d-78eec2805e1c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.791340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a2b17-4a5e-484e-8fdc-51bcc42b4377 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.814714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.815280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.815558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.815830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.816530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:28.816833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.818274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.830574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 374/749] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:28.835837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.842270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:28.843263 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:28.843740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:28.844203 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:28.845037 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:28.845531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:28.847789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:28.852823 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:28.872381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 376/750] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:28.872381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:28.973758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f3f67-e415-40f6-ac4c-7e39945a4b05 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:28.995389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef16fdd-ffb5-44be-8c26-99d7cad2c137 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.012418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.013148 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.013430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.013698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.024193 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.025653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:29.044070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:29.045030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:29.045969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:29.048278 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 375/751] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:29.048688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.049476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.049634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:29.049929 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.055288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.055288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=240b2bed570e4968a81057b1c9495353) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:29.055288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.055288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.060480 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 377/752] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:28 2022] GET /identity/v3/role_assignments?user.id=240b2bed570e4968a81057b1c9495353&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:29.061493 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:29.064498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:29.177181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:29.201327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049eae-3988-4355-834a-4b663c041c0c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.266500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.267466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.267749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.268074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.281752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.283258 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.299211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32964c7f-a841-4fd7-9bb2-d005d471e997 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:29.307913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:29.309634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:29.310577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 376/753] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:29.320066 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:29.341268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.341984 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.342267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.342540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.343349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:29.343655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.345161 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.365063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 378/754] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:29.370207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:29.465401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:29.525700 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab4c6-168c-4fd0-a721-a0898d355588 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.546675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d9074-7bdb-4756-ab18-e60beaa510cd None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.581664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:29.590344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.590936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.591244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.591519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.592262 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:29.592567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.594010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.609479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.610120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.610398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.610669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.622281 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 377/755] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:29.623325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.624987 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.627819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:29.642461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:29.643483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:29.644491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:29.644491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:29.644491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:29.646531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 379/756] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:29.656038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:29.740470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66671f68-63c4-46ad-ba86-ffa83e47aad2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.781390 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442d10-a585-4900-9b36-0a689aa9ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.782096 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442d10-a585-4900-9b36-0a689aa9ded4 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.782449 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442d10-a585-4900-9b36-0a689aa9ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.783250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442d10-a585-4900-9b36-0a689aa9ded4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.858763 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:29.878339 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442d10-a585-4900-9b36-0a689aa9ded4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.880611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165513a5-ba15-4ddc-add6-efdaa468b415 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:29.882462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442d10-a585-4900-9b36-0a689aa9ded4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.907631 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:29.949900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:29.954890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.955427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.955880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.956711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:29.957216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:29.958783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123c81-eb64-4560-ac06-05c9e0f66ca8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:29.984024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 380/757] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:29.985573 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb9b8-3882-4589-86b4-2ae77741b993 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:29.987059 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb9b8-3882-4589-86b4-2ae77741b993 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:29.987723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb9b8-3882-4589-86b4-2ae77741b993 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:29.991810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 381/758] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:29.992854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb9b8-3882-4589-86b4-2ae77741b993 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.046198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 378/759] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 04:26:30.047688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.047977 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.048254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.069214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:30.070462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:30.114688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb9b8-3882-4589-86b4-2ae77741b993 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.153391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.154350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.154812 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.155307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.159215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 379/760] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:30.160285 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.168084 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.172609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:30.192027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:30.192949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:30.193815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:30.196497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 382/761] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:30.202450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.204379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:30.249784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:30.320914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69cc7-f1ee-4a1a-afd7-91bc3c41a8d8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.359801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.360569 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.360942 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.361314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.362105 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:30.362525 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.364079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.378807 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 383/762] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:30.388454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.428023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ac37c-e9c5-47c7-be17-10e4f7b4e735 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.493394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.494034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.494307 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.494574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.512372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.514067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:30.531709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:30.532906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:30.534007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:30.534007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:30.534007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:30.535821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 380/763] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:30.536747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.544101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:30.554188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749852e-4f0d-4ffe-92c7-847eecfe3a3b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.592943 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.593619 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.593893 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.594173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/d2fb8c8ee6324e4ba6c328a9c2450fde/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.596191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=d2fb8c8ee6324e4ba6c328a9c2450fde, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.597725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.623130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 384/764] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:30 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/d2fb8c8ee6324e4ba6c328a9c2450fde/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:30.623130 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.641981 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:30.705508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3ec3-77f3-4d96-9a73-e22c2e5e1c9f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.759828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.760500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.760804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.761081 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.761744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.763726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:30.774461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:30.775577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:30.776422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:30.779064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 381/765] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Sep 9 04:26:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:30.788176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.869831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63941f0-1871-4925-b5a3-f1f846275597 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.914402 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.916053 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.916572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.917007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.917662 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:30.918557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.920000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fdd32-972a-4fb5-8c9e-817decf759c8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.922740 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a959576-4e79-4f50-b10f-f4c46fdd1cae None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:30.933997 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 385/766] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:30.936000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c0969-b30b-4f41-abb8-c0af08e02d6e None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.936496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c0969-b30b-4f41-abb8-c0af08e02d6e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.936965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c0969-b30b-4f41-abb8-c0af08e02d6e None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.942741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 386/767] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:30.943752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c0969-b30b-4f41-abb8-c0af08e02d6e None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:30.961962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:30.969704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:30.970598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.971116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.971569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:30.972412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:30.974014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:30.976113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852d89-be56-4941-ad00-c6b32002c388 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:30.979261 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:30.984707 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 9 04:26:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:30.988465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:30.988811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:30.989235 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.007908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:31.009194 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:31.079730 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c0969-b30b-4f41-abb8-c0af08e02d6e None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.091328 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 383/769] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:31.093056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.120824 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.122509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.122996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.123502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.131962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.133822 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:31.147827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:31.148721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:31.149616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:31.152430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 387/770] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:31.159373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.244577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:31.284776 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080998-ee8f-4ea6-84d2-02ebbb8839a1 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.340891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.343642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.346046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.346852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.352244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:31.353092 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.354858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.361566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce652-04d2-419c-ac89-76b6dad7f54b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.377864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 388/771] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:31.383937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.433028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:31.442283 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.443282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.443789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.444211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.445137 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:31.445615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.447247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.454323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 384/772] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:31.455624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.539227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde55a4-5bfd-4709-b37c-f9c661f0f182 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.570257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf31a-5c94-4fab-8feb-a4100f0e4ba6 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.573583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:31.580799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.581634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.582126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.582565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.583459 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f83b90b6521741e4952c771c2456c8a4) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:31.583909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.585730 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.592829 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 389/773] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/role_assignments?user.id=f83b90b6521741e4952c771c2456c8a4&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:31.593871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.622871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.624641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.625168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.625651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] PATH_INFO: `/v3/services/network` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.626512 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.628902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-c4a23409-6111-43b6-a3f8-50f3c51520fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:31.643720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:31.644800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:31.645635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:31.649456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 385/774] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:31.651122 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435ae50-fac0-4de4-aede-dfabef6c39b2 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.651608 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435ae50-fac0-4de4-aede-dfabef6c39b2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.652064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435ae50-fac0-4de4-aede-dfabef6c39b2 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.654480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 386/775] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:31.662529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435ae50-fac0-4de4-aede-dfabef6c39b2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.744377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4458-2edc-47a4-9633-a15080ba2399 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.750654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:31.789584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.790195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.790472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.790743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.791498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] RBAC: Adding query filter params (interface=public, service_id=90fd15475a4b4f5fb538182036aaa919, region_id=RegionOne) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:31.791805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.793705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264e43-48c6-4fbd-affb-589529dc9cfc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.803661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 390/776] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/endpoints?service_id=90fd15475a4b4f5fb538182036aaa919&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:31.805204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.805698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.806172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.807256 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435ae50-fac0-4de4-aede-dfabef6c39b2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:31.827011 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:31.828589 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:31.851987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:31.852555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:31.852774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:31.853043 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:31.853669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] RBAC: Adding query filter params (name=network) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:31.853968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:31.855913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:31.865311 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 387/777] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:31.866288 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.893584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:31.907313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 391/778] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:31.916263 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:31.975985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8242e8-1328-42f1-962a-5ceeaaf1a290 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.000392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:32.013917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.014777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.015240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.015661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:32.016412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:32.017955 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:32.031238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 388/779] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:32.101574 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56e40-0355-4364-b25c-f403b633d24c None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.159754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.160358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.160691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.160971 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:32.161623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] RBAC: Adding query filter params (type=network) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:32.161928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:32.163359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:32.173769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 392/780] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:32.179722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:32.276684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:32.313753 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ea2e-1721-4160-83a0-336f21fea779 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.346627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:32.352774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.353404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.353680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.353955 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:32.354681 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] RBAC: Adding query filter params (interface=public, service_id=2cc0fe55a34642989c4e28c9c0788f10, region_id=RegionOne) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:32.354961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:32.356417 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:32.368980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 389/781] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:26:32 2022] GET /identity/v3/endpoints?service_id=2cc0fe55a34642989c4e28c9c0788f10&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:32.370240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:32.400670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db789d0-89a2-4179-86fa-d465f72354be None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.436778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:32.461919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.465023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.465301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.465570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:32.491122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:32.497483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:32.498450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:32.499340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 393/782] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:32.506196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:32.531652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e4d4a-2166-416a-80c6-562260d72cb1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.597773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.598400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.598679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.598951 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:32.599812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:32.601227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:32.620410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 390/783] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:26:32 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:32.698842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca1eb-c0ac-46c7-a06c-01a288bcd105 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.722209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:32.747346 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.747971 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.748250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.748528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:32.749207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:32.749514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:32.751018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:32.761168 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 394/784] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:32.767371 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:32.892120 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe956-d696-476a-8d9e-b92c3d850775 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:32.906744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:32.927359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:32.928028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:32.928272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:32.928544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.057921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:33.059884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-e1f532f3-7f32-4d64-9e1c-0a2d45d7936a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:33.075782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:33.076776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:33.077666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:33.077666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:33.077666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:33.077666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 391/785] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:33.082687 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:33.236890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7efaa8-10af-4b18-9eb2-e766fa13379a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:33.260038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd230-8315-41e4-91cc-a97532354836 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:33.260358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd230-8315-41e4-91cc-a97532354836 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:33.260607 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd230-8315-41e4-91cc-a97532354836 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.267239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 392/786] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:33.274031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:33.274323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:33.274581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.279854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:33.280492 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:33.280771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:33.281172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.281830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:33.282240 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:33.283660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:33.293792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:33.295006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:33.302329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 395/787] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:33.308061 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:33.347013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:33.397655 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 393/788] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:33.455155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b94a2b-29a9-4f59-9a3f-e02706bee5e9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:33.500993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:33.501641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:33.501928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:33.502196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.511586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:33.513141 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:33.529920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:33.530899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:33.531875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 396/789] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:33.536687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:33.680184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:33.688005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1fc2c-b83a-46e7-a8f0-a9039e7f6bfc None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:33.725327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:33.725940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:33.726216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:33.726486 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.727250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:33.727555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:33.728992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:33.747679 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:33.752330 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 394/790] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 9 04:26:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:33.758304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:33.898409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3f320-fde3-429d-9198-457b48c7d6c2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:33.968447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:33.970960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:33.971635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:33.971913 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:33.972241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:33.980038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373669a-3e20-4a0b-ba99-cbdb52ef494e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:33.999425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.000891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:34.033184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:34.034184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:34.035064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:34.035064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:34.035064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:34.038283 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 395/791] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:34.048518 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.062607 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.063297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.063580 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.063859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.067503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.084749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:34.091379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:34.092294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:34.093621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 397/792] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:34.100662 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.217768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65762b0-282b-40df-9f2b-926a318f08b7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.243211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d474b2-eac5-4903-b99b-ec2103d8acd7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.258980 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.259761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.260297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.260671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.262475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:34.262946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.264463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed31e4-079e-45a2-ad44-3836830e0c8b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.275341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 398/793] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:34.276881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3964-92a4-44b4-ae95-c113c4f16689 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.277374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3964-92a4-44b4-ae95-c113c4f16689 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.277771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3964-92a4-44b4-ae95-c113c4f16689 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.280600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 399/794] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:34.281379 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb3964-92a4-44b4-ae95-c113c4f16689 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.281559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.282367 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.282808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.283303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.284113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:34.284580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.286197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf368db-3680-47a9-b1d2-61b0cdd91b66 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.299971 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 396/795] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:34.302372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.302862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.303372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.316937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.328071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:34.329974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:34.415741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.416424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb3964-92a4-44b4-ae95-c113c4f16689 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.429251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 397/796] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:34.430593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.455059 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.455970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.456319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.456686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.469884 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.471369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:34.488321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:34.489300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:34.490167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:34.490167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:34.490167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:34.490167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 400/797] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:34.495516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.557375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6316-bb62-4cb2-96a5-79f4d888c308 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.582184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.598273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.598273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.598273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.598273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.604250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.606108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:34.625050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:34.625979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:34.626860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:34.635169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 398/798] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:34.636060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.651954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93f60-be21-418d-b88e-38caa91b6912 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.735459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.740012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.740579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.740864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.741139 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.741790 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:34.742094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.746788 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.772581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 401/799] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:34.778231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.788785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e4a35-4f15-4591-b38b-f2a09d0c628f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.827662 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.828624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.829181 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.829627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.830491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:34.830980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.832604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.845436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 399/800] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:34.846255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.887827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476e22-8311-49b2-a7cb-30663cbc261e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.917338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.924786 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.925420 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.925697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.925967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.933192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:34.935121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c17d6c10-14a8-4303-b356-5f70f27659c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:34.946765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:34.947931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:26:34.948878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:34.953063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 402/801] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:34.954242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0523682-59d2-4cb9-b98b-fb283a71de2d None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.954529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0523682-59d2-4cb9-b98b-fb283a71de2d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.954798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0523682-59d2-4cb9-b98b-fb283a71de2d None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:34.956167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 403/802] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:34.956843 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0523682-59d2-4cb9-b98b-fb283a71de2d None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:34.958077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0248-9844-4ac3-87bc-a2708d9ff3df None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:34.978363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:34.998747 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:34.999336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:34.999615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:34.999884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.010741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:35.016507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:35.017429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:35.018317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 400/803] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:35.019077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.071016 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0523682-59d2-4cb9-b98b-fb283a71de2d None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.109457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2196-7664-48e0-a83d-8da73b3d9265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.110477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2196-7664-48e0-a83d-8da73b3d9265 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.110995 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2196-7664-48e0-a83d-8da73b3d9265 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.111490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2196-7664-48e0-a83d-8da73b3d9265 None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/240b2bed570e4968a81057b1c9495353/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.113570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf2196-7664-48e0-a83d-8da73b3d9265 None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=240b2bed570e4968a81057b1c9495353, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.115249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf2196-7664-48e0-a83d-8da73b3d9265 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.124861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78adf13-ffc9-49b8-a5c0-769005998bd6 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.128390 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 404/804] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:34 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/240b2bed570e4968a81057b1c9495353/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:35.129336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.129616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.129888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.149897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:35.151144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:35.187575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.189384 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.190010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.190670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.191856 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:35.192400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.194306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.211826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:35.231146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 401/805] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:35.231146 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.260511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 405/806] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:35.261231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.286029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:35.367038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b29a10-ffb9-464d-82e5-1a9301f27614 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.393966 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0f97f-4602-4155-bd43-7b231b8013dc None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.421213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.423006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.423493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.424202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.425281 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:35.425768 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.428040 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e49c9-0025-47a1-95e2-a766692cf2e2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.434904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.435653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.436342 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.436342 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.440821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 402/807] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:35.447375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe4b4f-62e3-43ca-a406-323939635a09 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.447831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe4b4f-62e3-43ca-a406-323939635a09 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.448253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe4b4f-62e3-43ca-a406-323939635a09 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.450539 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 403/808] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:35.451880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe4b4f-62e3-43ca-a406-323939635a09 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.501170 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:35.526082 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.529141 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.563567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:35.570858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe4b4f-62e3-43ca-a406-323939635a09 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.613120 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.613820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.614000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.614266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.625452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.626899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b3d457c5-fa40-4beb-b5c6-bfbb406c9ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:35.642313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:35.643298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:35.644216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:35.644216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:35.644216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:35.644216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 404/809] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:35.645060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091320-632e-4edd-9fce-2499bd8415af None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.645060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091320-632e-4edd-9fce-2499bd8415af None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.645245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091320-632e-4edd-9fce-2499bd8415af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.656969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 406/810] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:26:35.656969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.668684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-79091320-632e-4edd-9fce-2499bd8415af None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:35.669854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-79091320-632e-4edd-9fce-2499bd8415af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:35.744667 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:35.747479 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 405/811] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:35.748419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091320-632e-4edd-9fce-2499bd8415af None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.769848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044258e1-3698-42c1-bb5a-8ead19123e0c None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.811232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.812858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.813322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.813835 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.814675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.816231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:35.827946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:35.829108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 04:26:35.830144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:35.832625 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 407/812] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:35.834204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.837836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:35.863292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091320-632e-4edd-9fce-2499bd8415af None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.900178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.900791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.901163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.901555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:35.903021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:35.903505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:35.904980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:35.917219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 406/813] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:35.918472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:35.957684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219c50-fb1f-421e-81e1-f141187404de None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:35.997255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:35.998162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:35.998664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:35.999106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.027929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96542-aa52-447b-8eb4-c1a73e35951c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.066991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.067564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.067841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.068111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.068751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:36.069052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.070478 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.080660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 407/814] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:36.080660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.083356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.130341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.131833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.134955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:36.148121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:36.149076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:36.150564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:36.150564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:36.150564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:36.150564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 408/815] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:36.150564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.203316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c51bb-3b6f-4668-a8dc-1678ad2290b6 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.241431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.242157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.242335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.242607 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.250298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.251785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.262235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a700e-f808-46d3-89be-49fe045db0a7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:36.264259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:36.265227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:36.266158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:36.267423 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 408/816] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:36.268222 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.304724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.305404 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.305809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.306084 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] PATH_INFO: `/v3/services/network` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.306780 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.308182 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:36.317926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:36.318890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 04:26:36.319750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:36.323237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 409/817] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:36.324797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.340311 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.381658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4118a7-809d-4696-ad70-8253e63d96b6 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.388307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.416897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.417414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.418214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.418480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.419327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:36.419627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.420992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.430589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 409/818] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:36.430589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.439353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5a26-0c64-43f2-af81-47b05572d34f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.475429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.476023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.476296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.476562 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.477182 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:36.477474 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.478823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.496600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 410/819] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:36.496600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.544549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e12662-94b6-41a9-93eb-223c4773f378 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.576453 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.587620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.588231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.588513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.588786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.589554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:36.590071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.591564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.607615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47260-42b1-4511-83be-04b0d3e7a38f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.614239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 410/820] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:36.614239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.634659 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.651712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.652535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.652933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.653202 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.653819 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] RBAC: Adding query filter params (name=network) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:36.654115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.655480 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.660561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 411/821] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:36.661132 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.722502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb878a72-af60-4c2d-817d-739e8fb8055d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.758355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.758966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.759325 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.759599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.760306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.761753 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.765913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07837284-80fb-41c0-b051-e15d8506af1d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:36.787291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 411/822] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:26:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:36.788136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.818071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:36.819470 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:36.819983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:36.820469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:36.829888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:36.831735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:36.845832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:36.846811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:36.848160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:36.851917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 412/823] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:36.852894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:36.867078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.908523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:36.958902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ebc42-3e15-42d7-94e0-ee07bf3c5c27 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.006048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1cd6c-a912-4fbb-98e0-00b422b03d5d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.009178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.009818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.010142 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.010408 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.026093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.027668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:37.046028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:37.047016 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:37.047956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:37.047956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:37.047956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:37.047956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 412/824] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:37.047956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.051861 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.052489 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.052773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.053047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.053689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] RBAC: Adding query filter params (type=network) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:37.053989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.055392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.064583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 413/825] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:37.069221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.160968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:37.171664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541561dd-d067-41fb-a4b9-4deaf7a5d3c0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.198506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4249-8f66-4c22-8d19-32df57b6c7ed None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.202932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:37.208350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.209067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.209427 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.209770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.210699 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:37.210874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.212852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.232620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 413/826] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:37.234579 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.248940 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.249909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.250409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.250987 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.251897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:37.252502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.254118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.273135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 414/827] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:37.274370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.350711 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0023d7c-8cb3-4948-89eb-0540b2f618db None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.390580 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260e9f-dd5f-4cdb-8873-271c1975c7c9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.395051 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.395712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.395997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.396273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.396944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.398332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.423218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 414/828] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:26:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:37.432158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.451000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.451000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.451351 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:37.451428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.451428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.451428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=d2fb8c8ee6324e4ba6c328a9c2450fde) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:37.451428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.451428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b272ce-6f1f-4d7b-98b1-5505e9d6eef7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.468638 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 415/829] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:37 2022] GET /identity/v3/role_assignments?user.id=d2fb8c8ee6324e4ba6c328a9c2450fde&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:37.470122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a047bed-7052-4073-858d-d08c9a235a2d None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.470406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a047bed-7052-4073-858d-d08c9a235a2d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.471725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a047bed-7052-4073-858d-d08c9a235a2d None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.477234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 416/830] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:37.480951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.481272 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.481982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.522962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:37.525482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:37.573106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:37.630798 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c75c7-a1e4-44d3-99d5-1f82d0469a20 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.655798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 417/831] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:37.677918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.678494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.678773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.679047 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.688322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.689849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:37.705126 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:37.706091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:37.707220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 415/832] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:37.713685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.829314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351002-48bd-4cd7-b4ef-34a5fec9b971 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:37.866867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:37.867502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:37.867784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:37.868051 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:37.868798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:37.869095 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:37.870566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:37.883291 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 418/833] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:37.889594 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.965455 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:37.975892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:37.998905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:38.003207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f144-09e1-43ff-8698-94cbe1fd572e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:38.043440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:38.044267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:38.044645 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:38.045019 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f83b90b6521741e4952c771c2456c8a4/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:38.061233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=f83b90b6521741e4952c771c2456c8a4, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:38.062825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:38.087327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 416/834] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:37 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f83b90b6521741e4952c771c2456c8a4/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:38.103930 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb9387-2844-450e-a4ea-54f35ecef305 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:38.142932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:38.143621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:38.143901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:38.144172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:38.157399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:38.162834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:38.164464 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:38.165885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 419/835] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:38.170998 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:38.295851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d63593-533d-41c3-a0e6-ae0ee1f721be None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:38.315359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:38.335020 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:38.335837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:38.336121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:38.336392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:38.337064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:38.337365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:38.338816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:38.353191 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 417/836] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:38.354512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:38.434759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:38.461862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2dd7-38f4-4a82-9697-7a9279faf900 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:38.498838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:38.499420 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:38.499693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:38.499963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:38.511145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:38.512766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:38.527578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:38.529737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:38.531892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:38.531892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:38.531892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:38.535118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 420/837] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:38.535308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:38.643214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727837be-b418-4f02-b990-0e694f14fa93 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:38.678321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:38.678936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:38.679246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:38.679523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:38.680168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:38.680472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:38.681853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:38.694517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 418/838] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:38.700611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:38.804262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b5e4-2d87-477a-a736-49e0f701ca21 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:38.838338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:38.840779 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:38.841421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:38.841704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:38.841981 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:38.850731 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:38.852197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:38.864224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:38.866324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:38.868571 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 421/839] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:26:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:38.873583 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:38.923310 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:38.978457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c19ea-431a-48dc-9f31-cea4bac3d3de None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.014514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.015153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.015440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.015706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.016429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:39.016735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.018173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56489-1cc8-4ef8-b3ab-3e74cc1b8364 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.036655 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 419/840] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 9 04:26:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:39.042295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.153394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46d8a7-48a1-4021-a50d-d247ad8807b0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.173161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928ff2-430e-44af-abea-b1b8628eacd4 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.173460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928ff2-430e-44af-abea-b1b8628eacd4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.173719 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928ff2-430e-44af-abea-b1b8628eacd4 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.175316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 420/841] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:39.180042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.180310 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.180604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.198040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.198639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.199771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.200319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.209569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:39.211017 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:39.279152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:39.302728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.304336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.316805 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 421/842] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:39.412714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 422/843] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:26:39.419199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.448509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:39.525168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1d34-4875-4036-bf66-6091b87b6a94 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.563036 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.564446 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.565322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.565820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.576800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.578469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:39.593286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:39.594231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:39.595127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:39.595127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:39.595127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:39.597148 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 422/844] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:39.602898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.608416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.693903 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:39.713471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:39.716816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb2a71-46ca-4bfa-b84b-2b0015692402 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.733166 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d18c6-aec4-4a0d-b4a4-33a6b80d18a2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.755519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.756052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.756329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.756598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.757210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.758667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:39.769437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:39.770508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:39.771391 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:39.776004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 423/845] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:39.777629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.782200 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.783820 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.784093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.784357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.785013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:39.785311 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.786708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.812301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 423/846] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:39.813183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.907992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2586b48-35b4-424b-8902-99334290b30b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.926526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcb1c8-6393-4e37-b7a5-6da4c16f9c22 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:39.944352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.944892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.945172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.945447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.946077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:39.946380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.947789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd3e68-7413-4a80-b6cc-092f9381f928 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.953131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 424/847] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:39.954299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c9c9-ebbf-4d4f-9081-5c58ebe90428 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.954582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c9c9-ebbf-4d4f-9081-5c58ebe90428 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.954854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c9c9-ebbf-4d4f-9081-5c58ebe90428 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.956399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 425/848] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:39.960216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c9c9-ebbf-4d4f-9081-5c58ebe90428 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:39.968733 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:39.969374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.969652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:39.969926 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:39.972421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:39.977695 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:39.979240 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-d0d6fb41-2119-4850-b6da-9417bb014c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:39.991701 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:39.992793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:39.993874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:39.998107 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 424/849] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:39.999492 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:39.999779 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.000113 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.014301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:40.020816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:40.022009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:40.072952 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c9c9-ebbf-4d4f-9081-5c58ebe90428 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:40.097706 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 425/850] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:40.103958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:40.110238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:40.110848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.111153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.111430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.112064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:40.112358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:40.113733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:40.127537 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 426/851] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:40.224424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb019b-b703-4687-8ba2-440c76fce178 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:40.264110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:40.264729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.264993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.265254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.265946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:40.266247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:40.267781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:40.270848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:40.283634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 426/852] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:40.289399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:40.372525 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:40.373752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:40.419064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e0eb-18e3-4b3c-be62-375593b1fc74 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:40.463725 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:40.464859 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.465154 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.465419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.466149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=240b2bed570e4968a81057b1c9495353) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:40.466454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:40.467905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041fdb1-ebd1-4142-8056-4dddcf904576 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:40.473826 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 427/853] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:40 2022] GET /identity/v3/role_assignments?user.id=240b2bed570e4968a81057b1c9495353&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:40.475143 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7468-3614-4d3b-83d1-337bec34e254 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.475380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7468-3614-4d3b-83d1-337bec34e254 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.475652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7468-3614-4d3b-83d1-337bec34e254 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.477000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 428/854] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:40.483416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.483746 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.483973 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.502838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:40.504100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:40.505486 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c346f14-0421-4ac8-9bf6-ba747994a961 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:40.548259 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:40.548904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.549185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.549460 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.550058 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:40.551501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:40.562661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:40.563724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:40.564608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 427/855] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Sep 9 04:26:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:40.572298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:40.601794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 429/856] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:40.647693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:40.696298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2770-822e-4775-9c0d-59cdc64f3c15 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:40.732775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:40.733305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.733579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.733844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.734466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:40.734759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:40.736151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:40.741184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 428/857] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:40.746684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:40.816072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:40.854581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce4b3-d6ef-4b52-9862-d351f2b078be None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:40.875651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:40.893789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:40.894757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:40.895252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:40.895676 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:40.896461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:40.896949 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:40.898626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:40.905387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 430/858] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:40.992146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d022de-0508-43b1-b9fc-52ba80e522e6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:41.018893 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:41.030633 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:41.031314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:41.031957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:41.032234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:41.044280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:41.049866 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:41.050880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:26:41.051760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:41.055225 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 429/859] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:41.060490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:41.175136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8b0d0-8337-487b-8baa-177d02d2d677 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:41.205600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:41.212441 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:41.213306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:41.213802 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:41.214250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:41.215632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:41.216140 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:41.217683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:41.235269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 431/860] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:41.237492 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:41.344305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9785a2c-3e88-48cc-be2b-91ed5c9d1be9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:41.380319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:41.381323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:41.381804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:41.382275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:41.394174 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:41.395923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:41.410526 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:41.411554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:41.412414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:41.412414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:41.412414 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:41.419208 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 430/861] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:41.421129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:41.531212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38582e28-aedc-4601-af53-e418c68cd894 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:41.568920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:41.569884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:41.570392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:41.570881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:41.571748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:41.572252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:41.574411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:41.591386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 432/862] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:41.593267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:41.630433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:41.696264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1db8-fa80-49ea-9abc-54347f4e44f0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:41.731404 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:41.732438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:41.732921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:41.733394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:41.741416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:41.743140 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:41.755060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:41.756019 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:41.756934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:41.763217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 431/863] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:26:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:41.766233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:41.822804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:41.873323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2e396-7722-4ba2-b5f1-031c0386a27d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:41.909508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:41.910465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:41.910987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:41.911483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:41.912470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:41.913059 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:41.914685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:41.940464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 433/864] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 9 04:26:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:41.942232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:42.043830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:42.048740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22149a0f-5de6-4ba7-a8ad-aa5a9345bf1e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:42.083714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577dba4-13e1-4e2b-b20a-dab8483d0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:42.084340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577dba4-13e1-4e2b-b20a-dab8483d0d04 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.084670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577dba4-13e1-4e2b-b20a-dab8483d0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.084990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577dba4-13e1-4e2b-b20a-dab8483d0d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.158559 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577dba4-13e1-4e2b-b20a-dab8483d0d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:42.160440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577dba4-13e1-4e2b-b20a-dab8483d0d04 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:42.271352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:42.281902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 432/865] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:26:42.287775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:42.396872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67cec5-3105-4d5f-b411-2f31fbd691ac None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:42.402950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5709-5d36-43bf-aff4-5cc0db5e53d8 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.403290 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5709-5d36-43bf-aff4-5cc0db5e53d8 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.403567 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5709-5d36-43bf-aff4-5cc0db5e53d8 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.405185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 433/866] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:26:42.410354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:42.410543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.410727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.410978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.430884 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:42.432180 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:42.436476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652250db-93fb-4596-a274-9357177ed149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:42.437108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652250db-93fb-4596-a274-9357177ed149 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.437384 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652250db-93fb-4596-a274-9357177ed149 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.437654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652250db-93fb-4596-a274-9357177ed149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.448173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652250db-93fb-4596-a274-9357177ed149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:42.450151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652250db-93fb-4596-a274-9357177ed149 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-652250db-93fb-4596-a274-9357177ed149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:42.465513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:42.466528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:42.467462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:42.467462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:42.467462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:42.471189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 434/867] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:42.472654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652250db-93fb-4596-a274-9357177ed149 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:42.519351 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 434/868] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:42.588250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652250db-93fb-4596-a274-9357177ed149 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:42.624356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:42.624965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.625245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.625517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.626156 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:42.626457 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:42.627858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:42.644569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 435/869] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:42.645980 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:42.762076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ef570-59db-465c-98da-6837f9d32571 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:42.789819 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:42.799771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:42.800402 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.800678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.800948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.804759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:42.808663 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:42.811041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:42.822498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:42.823737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:42.828097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 435/870] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:42.830112 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:42.841979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:42.924737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414a04a-cc17-477f-81c5-61bc2efc080e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:42.940369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d09c-04cc-4cb3-8b18-79a5258f90d4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:42.962345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3080d-c390-4795-a04e-c78761145087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:42.963322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3080d-c390-4795-a04e-c78761145087 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.963825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3080d-c390-4795-a04e-c78761145087 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.964935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3080d-c390-4795-a04e-c78761145087 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.965925 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3080d-c390-4795-a04e-c78761145087 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:42.967538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3080d-c390-4795-a04e-c78761145087 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:42.980873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:42.981485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.981759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.982727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.983563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:42.983880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:42.991321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:42.991531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 436/871] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:26:42 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:26:42.991531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20de42-fe5e-484a-8917-d16d4a5dbb3a None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.991531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20de42-fe5e-484a-8917-d16d4a5dbb3a None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.991531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20de42-fe5e-484a-8917-d16d4a5dbb3a None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:42.991531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 437/872] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:42.996431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0af14-b518-4c8c-8525-db5ce5d88c96 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:42.996907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0af14-b518-4c8c-8525-db5ce5d88c96 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:42.997357 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0af14-b518-4c8c-8525-db5ce5d88c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.006270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 436/873] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:43.013014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:43.022282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-43e0af14-b518-4c8c-8525-db5ce5d88c96 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:43.023619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-43e0af14-b518-4c8c-8525-db5ce5d88c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:43.077059 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:43.121215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 438/874] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:43.153911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1fe4e-ea98-4f64-8cfa-1f7793b84db9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:43.192717 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:43.193569 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.194080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.194497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.195402 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f83b90b6521741e4952c771c2456c8a4) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:43.195851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:43.197413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1d82-8a1b-4167-8ad6-64a79e10b9fd None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:43.204637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 437/875] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:43 2022] GET /identity/v3/role_assignments?user.id=f83b90b6521741e4952c771c2456c8a4&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:43.349829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20a36c-31fb-4e01-a7af-23b31d72608b None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.350454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20a36c-31fb-4e01-a7af-23b31d72608b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.350931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20a36c-31fb-4e01-a7af-23b31d72608b None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.352889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 439/876] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:43.359446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.360079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.360573 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.381439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:43.383008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:43.414006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20a36c-31fb-4e01-a7af-23b31d72608b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:43.426428 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:43.464233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 438/877] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:43 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:43.534983 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20a36c-31fb-4e01-a7af-23b31d72608b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:43.574008 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:43.575076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.575631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.576107 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.576924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:43.578528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:43.588199 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:43.589197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:43.590670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:43.593506 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 440/878] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:43.601795 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:43.644199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:43.705737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859d6f-fce7-4bc3-8680-82001b8c8172 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:43.741306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:43.741922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.742202 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.742475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.743193 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:43.743498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:43.744917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:43.749520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:43.750962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 439/879] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:43.758516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:43.825058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:43.864593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cefec4-1a56-4436-8e73-0e8a038a3882 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:43.892261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991bbc-e6a9-4a26-8e1d-d9017d56d75a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:43.902173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd1820-859c-4ab0-9795-dafa317fb2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:43.903226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1820-859c-4ab0-9795-dafa317fb2a0 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.903707 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1820-859c-4ab0-9795-dafa317fb2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.904173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1820-859c-4ab0-9795-dafa317fb2a0 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.905028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1820-859c-4ab0-9795-dafa317fb2a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:43.906647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1820-859c-4ab0-9795-dafa317fb2a0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:43.914424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:43.928556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 441/880] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:26:43 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:26:43.945443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:43.946133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:43.946469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:43.946746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:43.947467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:43.947832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:43.950005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cdf0-e188-4c41-998b-ee9ddc342183 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:43.956418 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 440/881] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:45.264499 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2e44-7420-446b-8ed6-a57334534078 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:45.265062 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2e44-7420-446b-8ed6-a57334534078 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:45.265062 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2e44-7420-446b-8ed6-a57334534078 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:45.266629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 442/882] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:45.272140 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810e05e-de3b-44c6-bfbb-028f5b84e8b9 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:45.272572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810e05e-de3b-44c6-bfbb-028f5b84e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:45.272748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810e05e-de3b-44c6-bfbb-028f5b84e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:45.290744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3810e05e-de3b-44c6-bfbb-028f5b84e8b9 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:45.291976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3810e05e-de3b-44c6-bfbb-028f5b84e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:45.364868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 441/883] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:45.596738 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577c0c-599b-483a-a8c5-1a9d229ec8e8 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:45.596929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577c0c-599b-483a-a8c5-1a9d229ec8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:45.597208 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577c0c-599b-483a-a8c5-1a9d229ec8e8 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:45.598860 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 443/884] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:45.604108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:45.604497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:45.604924 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:45.623856 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:45.625196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:45.645794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577c0c-599b-483a-a8c5-1a9d229ec8e8 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:45.711754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 442/885] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:45.762354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577c0c-599b-483a-a8c5-1a9d229ec8e8 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:45.793163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:45.798488 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:45.799601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:45.800296 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:45.800839 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:45.801940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:45.803651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:45.814078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:45.815214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:45.816124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 444/886] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:45.824577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:45.851434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:45.932256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6774308-a322-40ea-8f5e-d234d58f0098 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:45.969952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:45.970559 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:45.970836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:45.971116 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:45.971753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:45.972059 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:45.973423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:45.978644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 443/887] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:45.984657 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.002080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.103604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f1e27-1160-4d8d-a30e-e2c5dd49bc86 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.124237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:46.139183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56aa456-5067-4cd6-bd30-552240a4dfd2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.147547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.148162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.148442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.148717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.149349 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:46.149659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.151036 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.162243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 445/888] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:46.163632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.186340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b67f-d8c6-4bd2-b0db-9c1217c62b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.187001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b67f-d8c6-4bd2-b0db-9c1217c62b83 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.187353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b67f-d8c6-4bd2-b0db-9c1217c62b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.187627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b67f-d8c6-4bd2-b0db-9c1217c62b83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.201482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b67f-d8c6-4bd2-b0db-9c1217c62b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-61d9b67f-d8c6-4bd2-b0db-9c1217c62b83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:46.207075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:46.208098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:46.208941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 444/889] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:46.209676 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be4ef-9c77-47e7-83ff-d6fd37811386 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.209750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be4ef-9c77-47e7-83ff-d6fd37811386 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.210329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be4ef-9c77-47e7-83ff-d6fd37811386 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.214346 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 445/890] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:46.216529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be4ef-9c77-47e7-83ff-d6fd37811386 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.250310 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:46.295410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5771-5a15-41ed-89e4-72ed76196257 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.330744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.331381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.331663 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.331937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.332635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] RBAC: Adding query filter params (interface=public, service_id=ce0864a90cab4d2a85efd81c60f6b94e, region_id=RegionOne) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:46.332736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be4ef-9c77-47e7-83ff-d6fd37811386 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.333162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.334308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4df05-8070-4fd1-8c69-d35cccba8842 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.339257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 446/891] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/endpoints?service_id=ce0864a90cab4d2a85efd81c60f6b94e&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:46.340404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.340687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.340961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.358465 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:46.359619 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:46.370353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.371600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.371883 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.372158 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.372823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:46.373129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.374485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef7420-515a-4a02-9768-7e53b8d98076 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.382772 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 446/892] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:46.383946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f353-781b-4194-ab79-d68f9b28abca None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.384229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f353-781b-4194-ab79-d68f9b28abca None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.384501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f353-781b-4194-ab79-d68f9b28abca None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.385680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 447/893] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:46.386424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f353-781b-4194-ab79-d68f9b28abca None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.398765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:46.432088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 447/894] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:46.433444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.492275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:46.492598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f353-781b-4194-ab79-d68f9b28abca None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.531196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a938e-a813-44fd-bf9d-9d64b99e9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.531862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a938e-a813-44fd-bf9d-9d64b99e9af4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.532076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a938e-a813-44fd-bf9d-9d64b99e9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.532350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a938e-a813-44fd-bf9d-9d64b99e9af4 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.532955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a938e-a813-44fd-bf9d-9d64b99e9af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.534313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a938e-a813-44fd-bf9d-9d64b99e9af4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.539737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6dc24-12b3-4b69-993c-0abaf231e8a2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.547578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 448/895] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 04:26:46.549360 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.550082 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.550594 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.575517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:46.577329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:46.585494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.586147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.586426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.586697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.598680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.600319 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:46.618577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:46.619641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:46.621203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:46.621203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:46.621203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:46.621203 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 448/896] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:46.626327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.666949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 449/897] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:46.718800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.723143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:46.755679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08b284-8a05-4a91-afa1-225634841b39 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.763809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:46.797394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.798106 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.798460 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.798831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.799611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:46.800096 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.801666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.815142 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 449/898] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:46.820547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.857024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a080-9ff0-4cae-88aa-5ef138f2cc08 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.905043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.906518 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.907004 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.907519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.908783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.911116 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:46.924496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:46.925497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:46.926421 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:46.931199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 450/899] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:46.934919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:46.940671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b08b6-e790-40b9-bf5e-83afcfb788ff None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:46.979014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:46.979679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:46.980743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:46.981026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:46.989103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:46.990558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:47.003282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:47.004304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 450/900] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:47.005269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.010314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.038834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.047901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0008-23fe-4189-b263-acfbed5447e2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.086868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300197-d13b-4d72-94b0-b934650934de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.087792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300197-d13b-4d72-94b0-b934650934de None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.088284 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300197-d13b-4d72-94b0-b934650934de None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.088716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300197-d13b-4d72-94b0-b934650934de None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.089438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300197-d13b-4d72-94b0-b934650934de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:47.089741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300197-d13b-4d72-94b0-b934650934de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.091126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300197-d13b-4d72-94b0-b934650934de None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.100793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 451/901] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:47.101435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300197-d13b-4d72-94b0-b934650934de None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.122638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a74b6-bf3a-4234-8054-d259d2953e7f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.160515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.161052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.161340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.161618 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.162271 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.163960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.179314 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 451/902] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:26:47 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:47.179999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.228095 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300197-d13b-4d72-94b0-b934650934de None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.269223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.282985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.284127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.284753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.285238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.286266 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:47.286809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.288559 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.313871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 452/903] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:47.314827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.315626 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.334644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362d2a8-c981-4a04-ab40-36cdbcdc0ed4 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.377362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.377925 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.378207 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.378591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.379313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:47.379611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.381035 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.391128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 452/904] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:47.393428 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.452326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e03f-ffd4-4d32-a5a2-0435f982c9af None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.503842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.507210 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.507492 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.507760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.520650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49213e-1356-4972-b990-3e960090dd92 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.556139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.557114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.557589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.558773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.560226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] RBAC: Adding query filter params (interface=public, service_id=7888afa8b06d40acade5a72d6a01f9d9, region_id=RegionOne) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:47.560775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.562414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.567776 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.568409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 453/905] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/endpoints?service_id=7888afa8b06d40acade5a72d6a01f9d9&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:47.574551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.587955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.589529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.627456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.689620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560f7c4-5b78-4992-abb6-20881b74824c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.696949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 453/906] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:26:47.697903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.728313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.729355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.730574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.731416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.732254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.734031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.740510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 454/907] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 04:26:47.807073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:47.825351 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6e96-e0b9-41ba-9dc2-31377813f046 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:47.865387 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:47.866029 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:47.866308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:47.866579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:47.878534 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:47.880043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:47.896979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:47.898002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:47.898885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:47.898885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:47.898885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:47.898885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 454/908] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:47.904912 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:47.991549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:48.016857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7d05-de35-4bcc-a92f-e6b4d4772a72 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:48.051222 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:48.051835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:48.052116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:48.052444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:48.053088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:48.053444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:48.054954 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:48.069654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 455/909] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:48.076069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:48.182965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca9e67-449a-4cc9-b5b1-8e8e7e2f8e97 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:48.219515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:48.220146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:48.220426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:48.220700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:48.227488 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:48.228932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:48.231399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:48.244506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:48.245429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:48.246803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 455/910] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:48.251876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:48.356007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018603c-b40f-49f2-a219-1b9420820b38 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:48.394917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:48.395918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:48.396409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:48.396876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:48.397777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:48.398275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:48.399923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948824fe-9b3f-4bc5-90ba-13998f1cc1a8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:48.412712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 456/911] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:48.419113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:48.420848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:48.530622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481c2d-7c4f-4b67-a5fe-e14c8d6a0adc None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:48.565634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:48.566236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:48.566511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:48.566781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:48.567535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] RBAC: Adding query filter params (role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f83b90b6521741e4952c771c2456c8a4) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:48.567832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:48.569243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439926b-7d55-4f61-a9ad-39e3a4effeca None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:48.577707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 456/912] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:48 2022] GET /identity/v3/role_assignments?user.id=f83b90b6521741e4952c771c2456c8a4&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:48.819466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ea9b-fe36-4098-a902-fa4704426ffd None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:48.819668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ea9b-fe36-4098-a902-fa4704426ffd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:48.819938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ea9b-fe36-4098-a902-fa4704426ffd None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:48.821510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 457/913] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:48.827138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:48.827435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:48.827708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:48.846585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:48.847800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:48.910646 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:48.924539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 457/914] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:49.191275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ea9b-fe36-4098-a902-fa4704426ffd None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:49.305930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ea9b-fe36-4098-a902-fa4704426ffd None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:49.341722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:49.342353 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:49.342628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:49.342896 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:49.343503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:49.344866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:49.353882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:49.355509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:49.357053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 458/915] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:49.361990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:49.472641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3931f0-4b37-4d41-850a-60781cf97dc4 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:49.509440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:49.510044 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:49.510318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:49.510588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:49.511295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:49.511568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:49.513149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c41b-68cd-42a9-9cd5-5a34ccb272c6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:49.518265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 458/916] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:49.524376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:49.566110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5991c-aa8d-4a8e-9c06-6ef6b949dc78 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:49.566651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5991c-aa8d-4a8e-9c06-6ef6b949dc78 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:49.566651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5991c-aa8d-4a8e-9c06-6ef6b949dc78 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:49.568228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 459/917] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:49.573936 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:49.574213 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:49.574491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:49.596176 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:49.597361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:49.602183 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:49.643855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0403f6-3d1c-42b4-93b7-054542fa4f03 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:49.660242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:49.683238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 460/918] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:49.692459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:49.693365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:49.693844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:49.694315 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:49.695190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:49.695714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:49.697320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:49.710227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 459/919] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 9 04:26:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:49.712078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:49.819611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1dedf-1bf9-4831-b068-fbdd96240824 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:49.856412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:49.857389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:49.857869 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:49.858339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:49.859252 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:49.860872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:49.893102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 461/920] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:26:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:49.957298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.087882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e610a4-9f75-4412-a0d1-07f683acefc2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.116421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:50.132640 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.133631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.134113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.134580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.135401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.137437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-e2fa0de6-a8b8-446e-b7aa-292fb0afe050 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:50.147116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:50.148329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:50.149334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:50.152591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 460/921] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:50.158637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.176685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128add6-965b-4fb5-9908-4f142f30e136 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.176968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128add6-965b-4fb5-9908-4f142f30e136 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.177231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128add6-965b-4fb5-9908-4f142f30e136 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.178911 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 461/922] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:50.185089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.185369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.185639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.204858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:50.205868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:50.216732 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:50.287422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 462/923] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:50.290605 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3cde-abd8-4dee-9c95-927c740113f8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.329932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.330637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.331057 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.331422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.332136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:50.332520 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.333958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.340023 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 462/924] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:50.345595 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.449020 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3e4c3-7b65-4cc5-a578-08174e7623d4 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.467052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:50.486927 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.487686 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.487961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.488229 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.488966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:50.489378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.490756 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.496700 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 463/925] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:50.502436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.559755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.611034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364f048-7a7b-4519-9d16-6370c1d15999 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.619222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:50.650164 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.650932 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.651348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.651767 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.652940 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] RBAC: Adding query filter params (interface=public, service_id=85e32f61995a447b9977f00af9c77275, region_id=RegionOne) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:50.653345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.654864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.660804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 463/926] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/endpoints?service_id=85e32f61995a447b9977f00af9c77275&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:50.668925 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.697061 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce940f-4b07-443e-b64b-ca79ce5c53b7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.735377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.736093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.736522 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.736838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.737282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.738698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:50.748344 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:50.749340 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 04:26:50.750230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:50.754632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 464/927] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:50.755543 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.806467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5dc9-f943-4da3-8d96-0155c88be721 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.812705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:50.844687 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f8f06-9799-423e-b8c6-6de61dfde036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.845437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f8f06-9799-423e-b8c6-6de61dfde036 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.845561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f8f06-9799-423e-b8c6-6de61dfde036 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.845816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f8f06-9799-423e-b8c6-6de61dfde036 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.846416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f8f06-9799-423e-b8c6-6de61dfde036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.847815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f8f06-9799-423e-b8c6-6de61dfde036 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.853864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 464/928] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 04:26:50.855317 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a530-e8ea-45be-b7a2-cd3920987c05 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.855613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a530-e8ea-45be-b7a2-cd3920987c05 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.855891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a530-e8ea-45be-b7a2-cd3920987c05 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.857297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 465/929] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:50.862850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.863196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.863380 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.888621 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488336d-6f37-40a7-9939-3b588b5ffe18 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:50.891564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:50.892820 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:50.924684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:50.925794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:50.926444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:50.926851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:50.927250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:50.927975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:50.928323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:50.929912 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:50.941548 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:50.942851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:50.982626 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 466/931] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:51.054511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d4288-cec6-4abc-b008-f673e9836e8e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:51.064578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:51.091985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:51.092594 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:51.092867 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:51.093134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:51.093763 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:51.094060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:51.095500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:51.100872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 466/932] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:51.108972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:51.214235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0127247-ce23-44a9-9f60-78ad598f5391 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:51.253192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:51.253806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:51.254088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:51.254359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:51.255043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:51.256436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:51.281435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 467/933] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:26:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:26:51.309227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:51.424233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33388b-c617-476b-a583-d989ccc3279e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:51.472297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:51.473664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:51.474414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:51.474846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:51.486793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:51.492967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:51.494232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:26:51.495503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:51.497710 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 9 04:26:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:51.503887 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:51.528783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:51.618267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fea3-97cc-4f8c-a318-d11e929a02b4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:51.660074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:51.661083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:51.661588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:51.662084 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:51.662949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:51.663477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:51.665054 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:51.674598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:26:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:51.680041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:51.711169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:51.788735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d2d8-5b06-44d6-be70-c7a383be5bc0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:51.829074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:51.830117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:51.830627 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:51.831118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:51.844462 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:51.846257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:51.861379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:51.862435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:51.863388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:51.863388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:51.863388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:51.865473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:51.872005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:51.960279 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:51.983893 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a31514-7a54-42f1-8d77-8b55fed3338a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.023443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.024422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.024897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.025381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.026244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:52.027652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.029206 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e025-0c1e-4883-90db-980381b7698e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.043036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 469/937] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:52.048895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.142474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:52.165153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b05d3-4503-4ebb-9d67-0ea736f8749a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.195950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066df72-af91-4f68-be10-8429f3218c7a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.196260 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066df72-af91-4f68-be10-8429f3218c7a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.196504 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066df72-af91-4f68-be10-8429f3218c7a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.200088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 470/938] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:26:52.203272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.204162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.204270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.204472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.204750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.205177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.205635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.214870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.216655 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.228447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:52.230436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:52.231383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:52.232316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:52.234939 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 469/939] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:26:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:52.235400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:52.240431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.319420 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 471/940] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:52.358198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4dfd-4975-4d25-a800-9a47e2510d51 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.394403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.395053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.395359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.395626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.396353 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:52.396653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.398076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.409804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:52.423441 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 470/941] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 9 04:26:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:52.425207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.503252 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:52.535322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fbde-7e18-4057-9a0f-30609a26547a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.570711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.571616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.572102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.572545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.584333 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.585993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:52.601904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:52.602871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:52.603797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:52.603797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:52.603797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.605628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 472/942] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:52.611362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.620121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.741598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea03388-1daf-4e04-ad27-1ef68f1f646d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.743714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5aaf-2a1c-4dbb-a9e6-8ecaa5d77faa None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.777228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:52.779402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.780218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.780991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.780991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.781785 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:52.782118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.783741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.791368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.793911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.794361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.794775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.796138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.798022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.799129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 471/943] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:52.804421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.805429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WARNING keystone.server.flask.common [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 04:26:52.830642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.sql.core [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 04:26:52.830642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 04:26:52.830642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [parameters: {'id': '630bdb43ac154bbb97e9f617e87dc745', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 04:26:52.830642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81489) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 630bdb43ac154bbb97e9f617e87dc745.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 630bdb43ac154bbb97e9f617e87dc745. Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application conn.query(q) Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 04:26:52.852781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result.read() Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 04:26:52.853648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application next(self.gen) Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application yield resource Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application next(self.gen) Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise self.value Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application session.commit() Sep 09 04:26:52.855258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.session.flush() Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application compat.raise_( Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 04:26:52.856151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 04:26:52.863245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application conn.query(q) Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result.read() Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 04:26:52.865156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [parameters: {'id': '630bdb43ac154bbb97e9f617e87dc745', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:52.867629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:52.869485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 630bdb43ac154bbb97e9f617e87dc745. Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 473/944] 10.222.0.18 () {60 vars in 1140 bytes} [Fri Sep 9 04:26:52 2022] POST /identity/v3/projects => generated 262 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:52.872303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:52.881525 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:52.929586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29977-bd83-46db-ada4-3f333af70098 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:52.971933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:52.973217 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:52.973759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:52.974728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:52.983989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:52.986600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:52.995126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa62ed-fcdd-4880-be70-1d4e04d32109 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:53.002102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:53.002999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:53.003915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:53.007175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 472/945] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:53.010368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:53.049259 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:53.049923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.050197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.050466 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.060080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:53.062650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:53.076958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:53.077907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:53.083881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 474/946] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:53.086034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:53.133033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826342-5fd0-4f05-a2aa-f9dddfbb9299 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:53.136024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:53.152359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:53.172368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:53.173117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.173397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.173695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.174399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:53.174700 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:53.176600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4aa4d-90f1-446c-8689-25c72618da79 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:53.192588 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 473/947] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:53.193613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c56e-67ae-4a66-a2e8-bb0b584a8e38 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.193899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c56e-67ae-4a66-a2e8-bb0b584a8e38 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.194175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c56e-67ae-4a66-a2e8-bb0b584a8e38 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.199666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 474/948] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:53.200079 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6c56e-67ae-4a66-a2e8-bb0b584a8e38 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:53.209271 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b2b9d-29a9-4116-b516-4330563da530 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:53.252147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:53.252765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.253039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.253307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.253965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:53.254261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:53.255714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dc45c-71af-4f38-9748-62c2248d732b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:53.287135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 475/949] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:53.287135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.287135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.287135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.306602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:53.309913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:53.334901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6c56e-67ae-4a66-a2e8-bb0b584a8e38 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:53.378004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3168f8-aed0-4adb-bb0f-c782412a776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:53.378672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3168f8-aed0-4adb-bb0f-c782412a776f None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.378943 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3168f8-aed0-4adb-bb0f-c782412a776f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.379249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3168f8-aed0-4adb-bb0f-c782412a776f None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f83b90b6521741e4952c771c2456c8a4/roles/b2b8b2a3bdb948f49b74eec4d7ee5a34` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.381439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3168f8-aed0-4adb-bb0f-c782412a776f None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=f83b90b6521741e4952c771c2456c8a4, role_id=b2b8b2a3bdb948f49b74eec4d7ee5a34)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:53.382901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3168f8-aed0-4adb-bb0f-c782412a776f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:53.402863 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 476/950] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:53.407404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 475/951] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:26:53 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f83b90b6521741e4952c771c2456c8a4/roles/b2b8b2a3bdb948f49b74eec4d7ee5a34 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:26:53.683838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:53.703961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7816-42b4-4d45-8445-36ee87a1c69d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.704478 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7816-42b4-4d45-8445-36ee87a1c69d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.704591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7816-42b4-4d45-8445-36ee87a1c69d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.706058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 476/952] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:53.711299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.711582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.711855 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.717083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:53.730972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:53.732213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:53.763666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:53.808675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa0b3-b23f-4cad-b88a-ca64ad54d4e6 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:53.817696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 477/953] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:53.848751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:53.849384 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:53.849657 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:53.849922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:53.850497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:53.851976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:53.861784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:53.863002 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:53.864614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 477/954] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:53.868748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:53.976059 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cebb03-3a2c-4426-b086-889f314402cb None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:54.016206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:54.016812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:54.017086 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:54.017354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:54.017980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:54.018277 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:54.019688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:54.025006 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 478/955] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:54.030951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:54.096276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:54.135507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:54.144086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:54.152497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f5ed-efd4-4656-a2eb-e79aafc98b9a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:54.191822 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:54.192430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:54.192715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:54.192985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:54.193609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:54.193905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:54.195317 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:54.202078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 478/956] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:54.207592 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:54.241362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc719d-7bc0-4fa7-aa42-6feb37184a71 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:54.281504 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:54.282653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:54.283492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:54.284219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:54.284993 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:54.287419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:54.300335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:54.301458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:54.302297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 479/957] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:54.310085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:54.345714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071871ca-cbd1-42aa-947e-3334a660f1d5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:54.391448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:54.392643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:54.393146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:54.393637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:54.394614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:54.396345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:54.413954 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:54.421020 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47c62d-bf8b-4c1b-8524-3aae72cf7227 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:54.429364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 479/958] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:26:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:26:54.471271 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:54.472050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:54.472330 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:54.472828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:54.473473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:54.473775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:54.475194 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bf87d-d10d-47d7-a9d5-13f5527dc555 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:54.481272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 480/959] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:54.487600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:54.506242 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:54.611237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092c380-c1aa-48a9-9d3d-15a5ee6abaa0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:54.648707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:54.649320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:54.649597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:54.649865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:54.650491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:54.650788 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:54.653121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122de22-ceec-40ce-84ce-5f035d347dc3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:54.658807 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 480/960] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:26:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:55.620807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ab42-7c19-47c9-aaa6-037a4c95c449 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:55.621760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ab42-7c19-47c9-aaa6-037a4c95c449 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:55.622248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ab42-7c19-47c9-aaa6-037a4c95c449 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:55.624189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 481/961] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:55.630303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:55.630783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:55.630881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:55.650108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:55.651901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:55.703119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2420-417a-447d-8694-4d5fce52edfd None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:55.703739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2420-417a-447d-8694-4d5fce52edfd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:55.704245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2420-417a-447d-8694-4d5fce52edfd None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:55.705984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 482/962] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:26:55.711351 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:55.711862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:55.712341 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:55.731688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:55.733212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:55.770322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 481/963] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:26:55.807484 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 483/964] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:56.045643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.056065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:56.077822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.163798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08f12-af92-4978-9e52-0b6c6f62a13e None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.185166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:56.209522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.213047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.213158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749a579-615e-44df-b571-0a1bff4b05fc None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.213257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.213257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.218083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:56.219577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:56.243196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.sql.core [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 04:26:56.243196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 04:26:56.243196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [parameters: {'user_id': '94fdd31e6abd46079a7a001c29bbfbce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 04:26:56.243196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81489) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application conn.query(q) Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result.read() Sep 09 04:26:56.251977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 04:26:56.253080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application next(self.gen) Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application yield resource Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application next(self.gen) Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise self.value Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application session.commit() Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 04:26:56.254065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.session.flush() Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application compat.raise_( Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 04:26:56.255830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 04:26:56.257977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application conn.query(q) Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application result.read() Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 04:26:56.261111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [parameters: {'user_id': '94fdd31e6abd46079a7a001c29bbfbce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:56.263761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 04:26:56.265740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 04:26:56.271325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 04:26:56.271325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 04:26:56.271325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 04:26:56.271325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 04:26:56.271325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 04:26:56.271325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:56.271755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.271755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.271755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.271755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.272048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 482/965] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 9 04:26:56 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:56.272048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.276851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:26:56.282475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:56.283438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:26:56.284331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:56.287202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 484/966] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:56.290699 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.363678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:56.402097 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7834-d666-4531-a25c-0ac06dc2f5a6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.409790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452d44-63b2-4856-9bb0-0a397b0e8a6f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.443558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.444568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.445136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.445718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.446650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.447279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.447553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.447821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.449068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:56.449368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:56.451079 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:56.456057 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:56.457947 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:56.464731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 485/967] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:56.465620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:56.472970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:56.473928 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 04:26:56.474874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:56.482283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 483/968] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:56.485335 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.485779 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:56.600603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdbc7f-ab65-4763-81ef-ccccd10dca8f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.601192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2eb4d-5ceb-4846-9b82-4b8a53299cc6 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.636629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:56.645405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.645698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.646109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.646296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.646554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.647274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:56.647572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:56.647781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.648261 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.648725 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.648990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:56.663869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:56.663869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:56.683816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:56.685289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:56.686297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:56.686297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:56.686297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:56.693040 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 486/969] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:56.693778 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:56.701238 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 484/970] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:56.770970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:56.824849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679729-e0a6-41de-89c0-1cd6ec49aa25 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:56.865005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:56.866026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:56.866511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:56.866994 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:56.867864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:56.868378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:56.870584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff1e7d-deca-4248-adf2-31a630658d3f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:56.884119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 487/971] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:56.890013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.006889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a526a-7111-4d92-98c4-47cd07a2dad4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.036793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91ee3-ab96-4511-980a-96f88aa0c02d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.037138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91ee3-ab96-4511-980a-96f88aa0c02d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.037368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91ee3-ab96-4511-980a-96f88aa0c02d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.038895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 488/972] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:26:57.045684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ce38-512b-4425-8a3f-c9f064cabf8e None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.045905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.046008 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ce38-512b-4425-8a3f-c9f064cabf8e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.046231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ce38-512b-4425-8a3f-c9f064cabf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.046442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.046720 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.046992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.055427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.056900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.066331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-3765ce38-512b-4425-8a3f-c9f064cabf8e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:57.067558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3765ce38-512b-4425-8a3f-c9f064cabf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:26:57.070075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:57.070985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 04:26:57.071969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:57.077622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 485/973] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:26:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:57.077710 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.129588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.144812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 489/974] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:57.155957 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6aca-f367-4c12-ad57-c797319d2e0a None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.156249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6aca-f367-4c12-ad57-c797319d2e0a None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.156530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6aca-f367-4c12-ad57-c797319d2e0a None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.157966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 490/975] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:26:57.162806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.163116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.163542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.182387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:26:57.183677 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:26:57.187339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081089b7-fe7a-4abd-9101-39f94b544721 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.228077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.228684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.228963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.229235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.231152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:57.231152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.233035 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.237749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.258539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 486/976] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:57.259565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.267125 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 491/977] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:26:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:26:57.364741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bf889-9bb2-4656-bcf5-3cf2bbf394c5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.372417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.400219 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.400748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.401022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.401352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.420544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.471705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.473399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.527520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d67d-39c5-4b85-b03d-5bd02ffd6679 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.562624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.563301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.563580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.563850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.564431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.565807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:57.575412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:57.576558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:26:57.577412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 492/978] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:26:57.578211 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.582612 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 487/979] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:26:57.583695 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.593806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.623377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.678237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698900-99bf-4dcc-bd6c-929f00ab98e2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.685769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543adab-743f-487c-8dba-bda30d91b5c8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.711762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.712371 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.712646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.712919 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.713564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.715176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.719981 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.720581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.720903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.721329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.722099 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:57.722433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.723955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.728800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 488/980] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:57.729575 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.729862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 493/981] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:26:57 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:26:57.734543 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.812076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.848278 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7889f-4ca2-4bf5-ad99-61f5e7e76ba5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.859587 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:57.865552 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c404-be7f-43d4-8fa4-f56edb8209c3 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:57.891775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.892805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.893283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.893717 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.903527 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:57.904149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:57.904456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:57.904730 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:57.905372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:57.905675 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.906364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:57.907078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.907839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:57.917815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 494/982] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:57.923806 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:26:57.924744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:57.925640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:26:57.926911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:26:57.926911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:26:57.926911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:57.926911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 489/983] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:57.932017 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:58.029816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b430f0e-0486-4136-a959-130823d9cde8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:58.045901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bd642-e3fc-42a0-8dda-65ecb22360e4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:58.063680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:58.064299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:58.064577 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:58.064847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:58.065552 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] RBAC: Adding query filter params (interface=admin, service_id=85e32f61995a447b9977f00af9c77275, region_id=RegionOne) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:58.065858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:58.067264 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:58.071666 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:58.072584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 495/984] 10.222.0.18 () {56 vars in 1249 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/endpoints?service_id=85e32f61995a447b9977f00af9c77275&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:26:58.078615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:58.090718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984837d3-d367-4181-9683-63617b2de19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:58.091355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984837d3-d367-4181-9683-63617b2de19c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:58.091634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984837d3-d367-4181-9683-63617b2de19c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:58.091904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984837d3-d367-4181-9683-63617b2de19c None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:58.092605 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984837d3-d367-4181-9683-63617b2de19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:58.092848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984837d3-d367-4181-9683-63617b2de19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:58.094184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984837d3-d367-4181-9683-63617b2de19c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:58.108678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 490/985] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:58.109532 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:58.114138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984837d3-d367-4181-9683-63617b2de19c None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:58.191996 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5d03-d71f-4eb4-8b47-858ba4dccc1f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:58.223568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984837d3-d367-4181-9683-63617b2de19c None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:58.233270 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:58.233888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:58.234163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:58.234513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:58.235025 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:58.236427 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:58.242965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 496/986] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:26:58 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 04:26:58.269990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:58.270641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:58.270917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:58.271243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:58.280074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:58.281540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:26:58.294313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:26:58.295338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:26:58.296220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 491/987] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:26:58.303241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:58.410406 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:58.423864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f06e34-b22e-440a-8abc-1805f5ded6bd None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:58.462042 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:58.462575 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:58.462852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:58.463180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:58.464380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:58.464683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:58.466167 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8e3b0-e814-4b34-8e6a-7068808d5dcb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:58.481175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 497/988] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:26:58.486703 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:26:58.531909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:26:58.590642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603ed4-6c3d-4921-9ece-ecdef8866343 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:26:58.624273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:26:58.624878 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:26:58.625156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:26:58.625424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:26:58.626147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] RBAC: Adding query filter params (role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f83b90b6521741e4952c771c2456c8a4) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:26:58.626451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:26:58.627907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18c13-21ca-406c-a149-c9db69fa31e9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:26:58.639121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 492/989] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:26:58 2022] GET /identity/v3/role_assignments?user.id=f83b90b6521741e4952c771c2456c8a4&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:00.045376 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180639-1b02-48ab-8c5f-005ae3bedd85 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.045892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180639-1b02-48ab-8c5f-005ae3bedd85 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.045970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180639-1b02-48ab-8c5f-005ae3bedd85 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.047410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 498/990] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:00.052517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae5c1-6d3b-4891-9e19-b18fa4da90a6 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.052912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae5c1-6d3b-4891-9e19-b18fa4da90a6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.053074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae5c1-6d3b-4891-9e19-b18fa4da90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.072725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-daaae5c1-6d3b-4891-9e19-b18fa4da90a6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:00.074265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-daaae5c1-6d3b-4891-9e19-b18fa4da90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:00.142921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 493/991] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:00.413326 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180639-1b02-48ab-8c5f-005ae3bedd85 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:00.498388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9359-2bc6-4c52-8800-8d59f230e22b None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.498718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9359-2bc6-4c52-8800-8d59f230e22b None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.498934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9359-2bc6-4c52-8800-8d59f230e22b None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.500295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 494/992] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:00.505682 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.505959 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.506227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.521067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180639-1b02-48ab-8c5f-005ae3bedd85 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:00.525817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:00.527640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:00.558036 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:00.558622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:00.558735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.558983 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.559549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.560134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:00.561596 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:00.570932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:00.572141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:27:00.573923 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:00.577130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 499/993] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:27:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:00.578019 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:00.597951 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:00.607261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 495/994] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:00.685169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948b354-ca66-4bf4-938e-fa848856d0bd None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:00.718726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:00.719358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.719637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.719904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.720531 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:00.720830 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:00.722192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6327fc-c685-45f5-9250-7b011a5f7e73 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:00.727077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 500/995] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:27:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:00.732865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:00.837403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5f27-e7a2-4ee5-81ed-0d09ddb4ccd6 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:00.871410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:00.871826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.872100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.872365 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.872875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63190e96-9077-4677-95d2-e292baac8325 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.872992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:00.873159 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63190e96-9077-4677-95d2-e292baac8325 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.873251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:00.873436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63190e96-9077-4677-95d2-e292baac8325 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.874603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b69e-149f-4edf-a517-f821926d0448 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:00.874755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 501/996] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:00.878601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63190e96-9077-4677-95d2-e292baac8325 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:00.879773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 496/997] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:27:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:00.880901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:00.881183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:00.881629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:00.900532 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:00.902410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:00.926068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:00.963918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:00.970161 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 497/998] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:00.971077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:00.985192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63190e96-9077-4677-95d2-e292baac8325 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.022365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.023399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.023931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.024396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.025177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.026972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:01.036500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:01.037459 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 04:27:01.038291 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:01.040640 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 502/999] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 9 04:27:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:01.046808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.077111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3be7-c21f-41f3-9681-b27b15622c83 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.114471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.115270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.115558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.115832 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.116533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] RBAC: Adding query filter params (interface=public, service_id=fbfab3967f174468bdad7881f18e2d04, region_id=RegionOne) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:01.116899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.118664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.123734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 498/1000] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:27:00 2022] GET /identity/v3/endpoints?service_id=fbfab3967f174468bdad7881f18e2d04&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:01.129237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.153216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee7df4-56a3-47f5-b832-272951d54fc1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.156359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:01.190092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.190696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.190971 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.191284 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.191905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:01.192232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.193784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.204382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 503/1001] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:27:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:01.205373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.221031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:01.250115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e649-1c8d-48bf-b75e-60a6c78009ae None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.284247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.284847 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.285126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.285397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.286001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.287382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.293484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 499/1002] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:27:01 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 04:27:01.294255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.316439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b7f3-a858-456d-a8e7-1ae2a3429103 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.356795 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.357430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.357711 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.357984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.358635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:01.358941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.360409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.365748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 504/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 9 04:27:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:01.372272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.411110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:01.428690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb14b-3d89-44b1-b423-af1b508b4461 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.457091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:01.470295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.470931 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.471289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.471503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.472081 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.473540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:01.483118 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:01.484134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:01.485802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 500/1004] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Sep 9 04:27:01 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:01.492576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.493604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28d9c-4ba7-40b5-a2c6-5f11f54cbed5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.538777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.540197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.540922 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.541401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.542723 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.544578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.571124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 505/1005] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:27:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:01.614100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1892-ff25-4b5e-923f-fd3f1748cbc3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.659423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.660043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.660316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.660587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.661212 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] RBAC: Adding query filter params (name=image) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:01.661508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.662880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef795a0-cfc3-4524-a59c-8762e3fe60aa None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.669444 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 501/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:01.675069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:01.784731 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690dfb-ac81-49fe-987f-b827ef567afb None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:01.814734 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:01.820784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:01.821392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:01.821682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:01.822542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:01.824373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] RBAC: Adding query filter params (type=image) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:01.824965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:01.826348 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38706756-64bc-4a0e-8c56-0f0ad208947e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:01.831182 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 506/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:03.496968 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7cb8-c041-4e2c-aa7c-8b7701965674 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:03.497511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7cb8-c041-4e2c-aa7c-8b7701965674 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:03.497511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7cb8-c041-4e2c-aa7c-8b7701965674 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:03.498909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 502/1008] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:03.503997 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc849-683a-4939-8204-5d19dfbe8ecc None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:03.504435 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc849-683a-4939-8204-5d19dfbe8ecc None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:03.504523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc849-683a-4939-8204-5d19dfbe8ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:03.522513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-069bc849-683a-4939-8204-5d19dfbe8ecc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:03.523739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-069bc849-683a-4939-8204-5d19dfbe8ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:03.593838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 507/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:03.786028 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8829aa-81f2-4c40-879e-6c33bf825596 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:03.786220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8829aa-81f2-4c40-879e-6c33bf825596 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:03.786497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8829aa-81f2-4c40-879e-6c33bf825596 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:03.787904 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 503/1010] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:03.794039 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13ca0-713e-456b-aa16-842e19e09139 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:03.794332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13ca0-713e-456b-aa16-842e19e09139 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:03.794613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13ca0-713e-456b-aa16-842e19e09139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:03.813720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a0c13ca0-713e-456b-aa16-842e19e09139 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:03.814932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a0c13ca0-713e-456b-aa16-842e19e09139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:03.865501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8829aa-81f2-4c40-879e-6c33bf825596 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:03.884368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:03.885136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 508/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:03.982423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8829aa-81f2-4c40-879e-6c33bf825596 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.017119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.017749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.018028 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.018299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.018880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.020278 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.022628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044c0d4-60d0-4607-941a-d6b2da5a6f31 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.022928 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044c0d4-60d0-4607-941a-d6b2da5a6f31 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.023233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044c0d4-60d0-4607-941a-d6b2da5a6f31 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.024555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 509/1012] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:04.029948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.030230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:04.030332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:04.031511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 04:27:04.032349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:04.033111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.033190 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 504/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:27:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:04.039031 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:04.050501 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:04.051730 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:04.125003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:04.154994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:04.155526 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 510/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:04.157670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:04.175338 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270be3-4011-493b-a2b2-d9694263a82b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.227117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.227117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.227117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.227117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.227545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:04.227545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.228233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.237416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 505/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:27:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:04.243062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:04.287010 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe65f5-3251-4a44-a705-e1d00425017b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.326687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.327352 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.327634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.327909 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.333136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.334601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.336364 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 511/1016] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:04.342139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:04.372766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1355a-cf9d-4512-a189-717cc3dc8e16 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.409334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:04.419946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.421229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.421811 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.422292 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.423133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:04.423619 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.425177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.431583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 506/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 9 04:27:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:04.433174 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:04.441337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:04.471721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6f23-624c-4025-a1d7-5e52fcd1a7f5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.509432 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.510059 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.510357 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.511212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.512103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.513559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.539288 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 512/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:27:04 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:04.540081 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:04.548441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca906f73-6dcf-4d3a-81cf-46c15d1d244e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.599778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c4667-c4d2-42bd-9f6c-806133ca5b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.600406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c4667-c4d2-42bd-9f6c-806133ca5b65 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.600729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c4667-c4d2-42bd-9f6c-806133ca5b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.601009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c4667-c4d2-42bd-9f6c-806133ca5b65 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.601708 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c4667-c4d2-42bd-9f6c-806133ca5b65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.603145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c4667-c4d2-42bd-9f6c-806133ca5b65 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.623148 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 507/1019] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:27:04 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:04.664004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e66d2-ea35-4694-9264-f8a795a34a68 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:04.672444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:04.716497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921872d1-6591-49e9-97d3-ed7d36174c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:04.717128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921872d1-6591-49e9-97d3-ed7d36174c72 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:04.717429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921872d1-6591-49e9-97d3-ed7d36174c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:04.717703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921872d1-6591-49e9-97d3-ed7d36174c72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:04.718392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921872d1-6591-49e9-97d3-ed7d36174c72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:04.719853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921872d1-6591-49e9-97d3-ed7d36174c72 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:04.742807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 513/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:27:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:06.815460 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb99f4-8289-4a17-98e3-bf9c5bcc2e18 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:06.815999 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb99f4-8289-4a17-98e3-bf9c5bcc2e18 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:06.815999 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb99f4-8289-4a17-98e3-bf9c5bcc2e18 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:06.817359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 508/1021] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:06.822586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b900-ad85-4ae9-a970-8eb1023bfc11 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:06.823027 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b900-ad85-4ae9-a970-8eb1023bfc11 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:06.823442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b900-ad85-4ae9-a970-8eb1023bfc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:06.841089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975fd5-0462-45e3-8a74-c5a66cb95359 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:06.841506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975fd5-0462-45e3-8a74-c5a66cb95359 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:06.841791 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975fd5-0462-45e3-8a74-c5a66cb95359 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:06.842653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c889b900-ad85-4ae9-a970-8eb1023bfc11 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:06.843276 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 509/1022] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:06.843871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c889b900-ad85-4ae9-a970-8eb1023bfc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:06.848153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2fa44-71cb-43fb-90a6-c4a6ba2d9be2 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:06.848439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2fa44-71cb-43fb-90a6-c4a6ba2d9be2 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:06.848716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2fa44-71cb-43fb-90a6-c4a6ba2d9be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:06.867216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-87a2fa44-71cb-43fb-90a6-c4a6ba2d9be2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:06.868419 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-87a2fa44-71cb-43fb-90a6-c4a6ba2d9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:06.927250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 514/1023] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:06.937441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:06.946715 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 510/1024] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:07.006031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce57afd-4502-4047-84ae-7d2f7e75ec06 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.006347 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce57afd-4502-4047-84ae-7d2f7e75ec06 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.006594 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce57afd-4502-4047-84ae-7d2f7e75ec06 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.008132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 515/1025] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:07.013558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.013916 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.014200 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.032943 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:07.034124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:07.102266 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 511/1026] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:07.200841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce57afd-4502-4047-84ae-7d2f7e75ec06 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.216711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.290938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:07.312228 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce57afd-4502-4047-84ae-7d2f7e75ec06 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.327808 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f8cdd-02c2-4ad5-a962-48278aa26611 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.349798 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.350431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.350713 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.350986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.352144 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.353760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.354994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:07.357279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 516/1027] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:07.363187 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.366179 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.366806 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.367080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.367376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] PATH_INFO: `/v3/services/image` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.367955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.369308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:07.378426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:07.379516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:07.380355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 512/1028] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:07.381240 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.466395 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff7a54-f2ca-4434-b8da-b0dbd5f68a94 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.480123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9ac5b-d33f-4d9d-8595-f25e683725ee None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.501278 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.501883 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.502160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.502430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.503077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.504555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.518086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.518937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.519299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.519582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.526484 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 517/1029] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:27:07 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:07.527892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.536519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:07.539687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:07.542455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:07.543755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:07.544642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 513/1030] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:07.550079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.613535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:07.644793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee861848-b107-4f6e-b915-c8088326217f None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.676642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fa5e4-3bb2-4fdf-8cad-039404efa70f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.684715 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.685500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.685613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.685880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.686521 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] RBAC: Adding query filter params (name=image) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:07.686824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.688267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.694514 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 518/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:07.700827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.723030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.723805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.724138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.724415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.725082 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:07.725384 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.726755 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.736475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 514/1032] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:07.742172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.784890 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:07.823549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf1494-39ab-4338-9ee4-f0ef94038724 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.854711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d7ac-6fc9-4335-940a-d856df6d98f4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:07.860973 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.862307 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.862741 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.863189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.864503 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] RBAC: Adding query filter params (type=image) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:07.864960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.865885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:07.867821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.873724 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 519/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:07.879490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.892046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:07.892679 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:07.893261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:07.893670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:07.905582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:07.907352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:07.923753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:07.924722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:07.925814 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:07.925814 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:07.925814 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:07.925814 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 515/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:07.930533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:07.985944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe44cd-bb9d-4559-8e61-daf4abf73c27 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.020255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.020884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.021140 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.021410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.022102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] RBAC: Adding query filter params (interface=public, service_id=076baecfd11a48d38480ea85538fc5f5, region_id=RegionOne) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:08.022407 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.023802 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.026257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:08.029824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 520/1035] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/endpoints?service_id=076baecfd11a48d38480ea85538fc5f5&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:08.035243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:08.049105 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37837a-3634-47e8-be65-7d3bfc213206 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.087205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.088145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.089030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.089302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.090068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:08.090484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.092036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.105925 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 516/1036] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:08.111476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:08.136770 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:08.148008 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11dd7e-fb1a-48fd-8de0-8ddb381d20b7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.185858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.186468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.186754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.187025 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.187688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.189064 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.199452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 521/1037] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:27:08 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 04:27:08.235703 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e660df1-f6fe-4072-948d-da39fa53ddd9 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.274739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.275427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.275722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.276128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.284853 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.286328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:27:08.299499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:08.300568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:08.306524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 517/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:08.309749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:08.380358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:08.421829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbd20-e3da-43fc-aa9e-842227a476b2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.456657 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.457268 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.457544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.457815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.458539 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:08.458848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.460312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.484241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 522/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:27:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:08.485974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:08.570899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:08.591337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e610-edba-4e15-b2b5-696bb28569d4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.626781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.627412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.627685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.627952 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.699519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.700987 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.781554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:08.806227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 518/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:08.808704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:08.914866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402831-be37-423d-98bf-2ce9ac9fa52c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:08.939153 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:08.952720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:08.953286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:08.953560 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:08.953827 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:08.964216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:08.965658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:08.980054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:08.981014 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:08.981907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:08.981907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:08.981907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:08.981907 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 523/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:08.988789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:09.090306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1692a-2f02-4196-ac1e-acdffed30b58 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:09.133367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:09.133965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:09.134243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:09.134515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:09.135188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:09.135533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:09.136902 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:09.148318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 519/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:09.154515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:09.264953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a469d41-09fc-4248-918f-55da673b4c10 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:09.300039 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:09.300679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:09.300965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:09.301237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:09.308270 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:09.309978 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:27:09.321292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:09.322186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:09.328633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 524/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:09.330938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:09.376540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:09.437126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ba94-5bfd-40db-b83c-fd946a17245f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:09.471568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:09.472172 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:09.472453 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:09.472753 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:09.473443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:09.473746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:09.475206 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef2540-cbf6-4171-b414-7b494f3a5986 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:09.488702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 520/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:09.494644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:09.530505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:09.597902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2b22f-6e71-4bce-bcb7-415dbd458a1a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:09.632009 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:09.632614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:09.632895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:09.633165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:09.633947 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] RBAC: Adding query filter params (role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=d2fb8c8ee6324e4ba6c328a9c2450fde) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:09.634257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:09.636428 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b6c78-2ee3-464b-97a7-543e040fa36e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:09.642121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 525/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:09 2022] GET /identity/v3/role_assignments?user.id=d2fb8c8ee6324e4ba6c328a9c2450fde&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:09.788906 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb068fa-1e27-449c-8295-7d095751848b None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:09.789083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb068fa-1e27-449c-8295-7d095751848b None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:09.789358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb068fa-1e27-449c-8295-7d095751848b None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:09.790861 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 521/1046] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:09.796873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:09.797151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:09.797421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:09.819184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:09.820371 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:09.891521 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 526/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:10.174281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb068fa-1e27-449c-8295-7d095751848b None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:10.288778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb068fa-1e27-449c-8295-7d095751848b None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:10.290745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:10.326435 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67beadf-0302-481c-9da6-fb4eb7175c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:10.327056 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67beadf-0302-481c-9da6-fb4eb7175c1f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.327359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67beadf-0302-481c-9da6-fb4eb7175c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.327627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67beadf-0302-481c-9da6-fb4eb7175c1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.337850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67beadf-0302-481c-9da6-fb4eb7175c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b67beadf-0302-481c-9da6-fb4eb7175c1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:10.343280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:10.344217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:10.345062 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:10.347453 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 522/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:10.350342 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:10.378900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:10.387149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d031-d0ad-494f-bdf7-e53cbc2f960c None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.387445 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d031-d0ad-494f-bdf7-e53cbc2f960c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.387718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d031-d0ad-494f-bdf7-e53cbc2f960c None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.389810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 523/1049] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:10.395044 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.395370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.395766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.414935 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:10.416186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:10.456266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112757-a17c-4ecc-93e3-862985cabb7d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:10.487133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 524/1050] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:10.492868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:10.493476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.493751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.494027 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.494706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:10.495002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:10.496413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:10.505041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 527/1051] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:10.511007 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:10.605881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:10.615991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0ec2-1d27-418a-86eb-173554000577 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:10.649443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:10.650079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.650366 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.650639 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] PATH_INFO: `/v3/users/857307f5f1e2468f96e930298d9234f0` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.664169 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] RBAC: Authorizing `identity:get_user(user_id=857307f5f1e2468f96e930298d9234f0)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:10.665604 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:10.672357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 525/1052] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:10 2022] GET /identity/v3/users/857307f5f1e2468f96e930298d9234f0 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:10.673681 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:10.767917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:10.768209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:10.780574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016b44-5de1-4031-a1b2-84682c7ca3e1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:10.816787 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:10.817393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.817669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.817938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.876944 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588538-f1a2-4b44-9e53-67f6776c13e0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:10.892783 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:10.894450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:10.913846 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:10.914475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:10.914754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:10.915030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] PATH_INFO: `/v3/services/image` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:10.915637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:10.917683 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:10.926734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:10.927781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:10.928654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 526/1053] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Sep 9 04:27:10 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:10.935129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:10.956627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:11.000879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:11.018874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 528/1054] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:11.019712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:11.047630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25621d3d-fe8d-4c2a-aa49-38b243a4048a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:11.080543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:11.081136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.081455 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.081682 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.082304 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] RBAC: Adding query filter params (name=image) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:11.082601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:11.083976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:11.089540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 527/1055] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:11.099229 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:11.127924 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9b32c-9d4c-41f3-a4fc-c6a7571f4ab8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:11.164245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:11.165174 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.165597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.166013 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.168248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] RBAC: Authorizing `identity:get_project(project_id=9145487f4c134ed08d2989de6852002b)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:11.169899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:11.171705 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 529/1056] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:11 2022] GET /identity/v3/projects/9145487f4c134ed08d2989de6852002b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:11.177567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:11.181042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:11.207183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37eeb2-02a9-4b15-aa9c-f87413b02377 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:11.244634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:11.250784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:11.251489 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.251854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.252207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.252899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:11.253268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:11.254640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:11.259994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 528/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:11.265862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:11.289398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892569-38d9-4ac2-bfe1-e8e26b9d4403 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:11.326346 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:11.326945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.327294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.327530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.328254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=9145487f4c134ed08d2989de6852002b, user.id=857307f5f1e2468f96e930298d9234f0) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:11.328557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:11.329992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a672b-0b72-497f-a415-fd8da73e3a85 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:11.335843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 530/1058] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:11 2022] GET /identity/v3/role_assignments?user.id=857307f5f1e2468f96e930298d9234f0&scope.project.id=9145487f4c134ed08d2989de6852002b&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:11.396247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c8736-6732-4e9c-98ca-4fae50bdb3c7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:11.434153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090ec1-1933-4f93-9d4b-513858153021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:11.435051 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090ec1-1933-4f93-9d4b-513858153021 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.435364 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090ec1-1933-4f93-9d4b-513858153021 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.435641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090ec1-1933-4f93-9d4b-513858153021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.436321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090ec1-1933-4f93-9d4b-513858153021 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:11.437719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090ec1-1933-4f93-9d4b-513858153021 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:11.454812 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:11.471627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 529/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:27:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:27:11.816837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5737056-1630-401e-b4cf-2def2d1f583e None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.817386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5737056-1630-401e-b4cf-2def2d1f583e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.817386 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5737056-1630-401e-b4cf-2def2d1f583e None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.818911 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 531/1060] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:11.824426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:11.824716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:11.824992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:11.843668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:11.844862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:11.920933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 530/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:12.191684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5737056-1630-401e-b4cf-2def2d1f583e None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:12.309713 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5737056-1630-401e-b4cf-2def2d1f583e None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:12.332088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:12.344985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:12.345613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:12.345891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:12.346161 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:12.356881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:12.361695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:12.362606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:12.367960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 532/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 9 04:27:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:12.370572 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:12.471696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890aaa2-017e-44b2-8878-ef61ce607ce5 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:12.496722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:12.508544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:12.509149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:12.509432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:12.509705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:12.510389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:12.510697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:12.512139 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:12.524244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 531/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:27:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:12.527056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:12.631168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89491-a857-4f4d-a555-d5aa0a365f35 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:12.667507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:12.668131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:12.668413 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:12.668937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:12.679394 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:12.680843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:12.695874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:12.696850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:12.702679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:12.702679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:12.702679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:12.702679 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 533/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:12.704467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:12.805177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd8de0-720f-4af2-a4c5-e8d5132a8ea5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:12.839673 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:12.840270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:12.840545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:12.840813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:12.841444 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:12.841744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:12.843124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:12.854907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 532/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:12.860309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:12.895743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:12.963255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ff0bc-7b2c-4d7a-b7d9-0b58fafac8d0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:12.996810 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:12.997439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:12.997717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:12.997986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.005437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:13.006906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:27:13.018609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:13.019837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:27:13.021158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:13.021992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 534/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:27:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:13.025528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:13.075285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:13.129371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83aa99-754e-4cc7-bf03-8870e0bc9ce7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:13.164976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:13.165580 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.165857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.166127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.167012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:13.167345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:13.168763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:13.186792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 533/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:27:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:13.192320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:13.297586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:13.305638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95ff2-bdf9-4647-965f-60f5532df016 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:13.340930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:13.341485 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.341763 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.342034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.352565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:13.354052 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:13.368048 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:13.369033 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:13.370463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:13.370463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:13.370463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:13.371356 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 535/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:13.375738 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:13.484576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efbcec-5388-4d47-be2b-52b7b4a85e38 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:13.487535 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:13.522491 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:13.523173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.523458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.523733 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.524374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:13.524678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:13.526152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d9f0-ac53-4b6c-97f9-6d1cd4223ce1 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:13.542398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 534/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:13.543874 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:13.556040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19758e-6de1-4c93-97bd-b89a5f748c14 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.556323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19758e-6de1-4c93-97bd-b89a5f748c14 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.556602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19758e-6de1-4c93-97bd-b89a5f748c14 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.558601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 535/1070] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:13.565702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d886c9b-720d-426a-82d9-d1791f32b7b1 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.566000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d886c9b-720d-426a-82d9-d1791f32b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.566286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d886c9b-720d-426a-82d9-d1791f32b7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.588745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3d886c9b-720d-426a-82d9-d1791f32b7b1 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:13.590328 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3d886c9b-720d-426a-82d9-d1791f32b7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:13.661402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54279cc-b1ca-4f39-9137-e53fb525f342 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:13.662368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 536/1071] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:13.679515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e48481-8ea0-4761-9dab-6c7f75992d7f None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.679993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e48481-8ea0-4761-9dab-6c7f75992d7f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.680133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e48481-8ea0-4761-9dab-6c7f75992d7f None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.681512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 537/1072] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:13.687315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.687597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.687874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.698495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:13.699155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.699436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.699706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.705927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:13.706512 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:13.707072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:13.707991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:27:13.719529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:13.720500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:13.721383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 536/1073] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:13.726421 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:13.736378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:13.782809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 538/1074] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:13.833779 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9639364-3ead-4c17-ab80-26500a73d1b1 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:13.868536 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:13.870644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:13.871125 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:13.871604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:13.872555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:13.873035 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:13.874706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:13.890129 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 537/1075] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:13.895728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:13.924175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:13.929904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.002766 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.009306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec17d-6bd1-4bc4-9856-ad97a14b8ccd None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.042029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33fdf-8af8-4a48-b3c4-5c489ce7f60e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.047039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.047722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.048001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.048296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/d2fb8c8ee6324e4ba6c328a9c2450fde/roles/b2b8b2a3bdb948f49b74eec4d7ee5a34` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.050445 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=d2fb8c8ee6324e4ba6c328a9c2450fde, role_id=b2b8b2a3bdb948f49b74eec4d7ee5a34)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.051910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.065741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 539/1076] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:27:13 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/d2fb8c8ee6324e4ba6c328a9c2450fde/roles/b2b8b2a3bdb948f49b74eec4d7ee5a34 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:27:14.066803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.081898 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.082558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.082837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.083123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.095660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:14.100604 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:14.101617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:14.102464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 538/1077] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:14.109005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.164604 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.183454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff497ad8-6bea-467c-90cf-5c52a4afbb44 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.232472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023adb62-90ea-48e9-b73c-ea17838061aa None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.233514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.234471 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.235155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.235155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.266475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.276306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.276927 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.277209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.277488 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.278165 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:14.278468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.279882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.288277 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 539/1078] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:14.294056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.320568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.322005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.401495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6849726-1872-4c6e-ae02-ab3f96a8ed7e None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.411899 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.429938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 540/1079] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:14.436924 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.444176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.444822 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.445220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.445502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] PATH_INFO: `/v3/users/857307f5f1e2468f96e930298d9234f0` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.446650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] RBAC: Authorizing `identity:get_user(user_id=857307f5f1e2468f96e930298d9234f0)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.448695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.450780 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 540/1080] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:14 2022] GET /identity/v3/users/857307f5f1e2468f96e930298d9234f0 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:14.456218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.517218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.545825 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec8a3-8898-4fa1-a52d-c22a0989e4c5 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.566183 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814658f2-e7b4-4118-9ae3-b64d8781d859 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.582403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.583031 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.583344 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.583616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.594361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.595831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.602343 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.603383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.603684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.604508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.606027 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] RBAC: Authorizing `identity:get_project(project_id=9145487f4c134ed08d2989de6852002b)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.607499 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.609362 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 541/1081] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:14 2022] GET /identity/v3/projects/9145487f4c134ed08d2989de6852002b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:14.611627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:14.612530 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:14.618586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:14.618586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:14.618586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:14.618586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 541/1082] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:14.618879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.622067 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:14.659509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.726760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842223b3-7f3c-4d9b-8eeb-970f950810b0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.733621 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada367-d5a0-4c6c-af66-f081baea51c7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:14.753055 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:14.767323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b911-675e-423c-b1ac-a71ea63fa151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.768303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b911-675e-423c-b1ac-a71ea63fa151 None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.768854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b911-675e-423c-b1ac-a71ea63fa151 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.769141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b911-675e-423c-b1ac-a71ea63fa151 None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b/users/857307f5f1e2468f96e930298d9234f0/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.771031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b911-675e-423c-b1ac-a71ea63fa151 None admin] RBAC: Authorizing `identity:create_grant(project_id=9145487f4c134ed08d2989de6852002b, user_id=857307f5f1e2468f96e930298d9234f0, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.772585 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:14.772721 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b911-675e-423c-b1ac-a71ea63fa151 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.773199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:14.773482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:14.773759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:14.774399 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:14.774712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:14.776640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccae0b-fab2-410b-823c-3c5f74742643 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:14.788985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 542/1083] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:27:14 2022] PUT /identity/v3/projects/9145487f4c134ed08d2989de6852002b/users/857307f5f1e2468f96e930298d9234f0/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 04:27:14.791155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 542/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:16.251780 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2e34a-29b2-4ff4-9ae7-f3b9e0d2d233 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:16.252299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2e34a-29b2-4ff4-9ae7-f3b9e0d2d233 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:16.252436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2e34a-29b2-4ff4-9ae7-f3b9e0d2d233 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:16.253774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 543/1085] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:16.259079 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:16.259513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:16.259650 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:16.278142 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:16.279359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:16.344964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 543/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:16.611904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2e34a-29b2-4ff4-9ae7-f3b9e0d2d233 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:16.714928 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2e34a-29b2-4ff4-9ae7-f3b9e0d2d233 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:16.748608 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:16.749236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:16.749516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:16.749792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:16.760302 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:16.765234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:16.767188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:16.768185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 544/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 9 04:27:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:16.772308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:16.798697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:16.876660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d4f19-2aff-41f4-893f-b58541383701 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:16.909388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:16.909990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:16.910268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:16.910536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:16.911227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:16.911528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:16.912883 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6553-16e2-430b-983c-cb6504c3ce1b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:16.921407 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 544/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:27:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:16.927373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:16.945722 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce641b-525f-43e8-a7be-e759bcfbabfc None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:16.946005 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce641b-525f-43e8-a7be-e759bcfbabfc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:16.946274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce641b-525f-43e8-a7be-e759bcfbabfc None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:16.947666 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 545/1089] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:27:16.952476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:16.952759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:16.953034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:16.970425 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:16.971634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:16.974029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.030164 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8481c-8f5c-412c-bd5f-2f639bab0fc9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.037358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 546/1090] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:17.065195 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.065818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.066095 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.066369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.077092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.078529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:17.092505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:17.093646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:17.094915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:17.094915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:17.094915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:17.094915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 545/1091] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:17.099252 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.117758 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.196432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b1f29-ae99-4ae9-8cdd-bba95e6fcdcf None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.233570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.234204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.234485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.234756 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.235422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:17.235724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.237117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.249195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 547/1092] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:17.254535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.311506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.350933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.357547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edcbd5-163d-41a9-b480-9bb26db41562 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.390739 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.391606 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.392216 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.392498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.392770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.400027 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.401528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:27:17.412703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:17.413709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 04:27:17.414666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:17.415273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ddc14-cb6a-4908-ab0b-92afa4aa86d7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.415354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 546/1093] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:17.420160 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.449043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.449599 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.449881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.450151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.460073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:17.465309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:17.466254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:17.467280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 548/1094] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:17.472756 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.520736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d254ba-475f-44b1-a3d6-807446078f69 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.554178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.554783 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.555062 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.555363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.556081 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:17.556382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.558458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.573033 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776f4e5-bc15-4fac-b8d4-93d08949b4ec None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.575387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 547/1095] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:17.581029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.595856 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.607591 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.608545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.608831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.609100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.609754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:17.610054 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.611429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.616376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.623384 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 549/1096] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:17.627769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.682045 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe88a5-7c2c-438c-ad10-a68af51d940a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.718544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.719070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.719372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.719641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.728617 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389951-260b-47e3-8903-10211f4a65c3 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.762292 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.762911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.763227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.763509 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] PATH_INFO: `/v3/users/857307f5f1e2468f96e930298d9234f0` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.764616 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] RBAC: Authorizing `identity:get_user(user_id=857307f5f1e2468f96e930298d9234f0)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.766025 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.767590 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 550/1097] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/users/857307f5f1e2468f96e930298d9234f0 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:17.773285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.786425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.787897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.801876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.839954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:17.873667 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd59d2-5cd3-4a5a-b6ca-7b491ba818a1 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:17.886483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 548/1098] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 04:27:17.892176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:17.912298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:17.912896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:17.913171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:17.913438 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:17.979756 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:17.981114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:17.988213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ace67-6ec3-4841-b710-63ae4b39aae3 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.002198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:18.023184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.023813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.024093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.024372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.034358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.035848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:18.050234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:18.051251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:27:18.052149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:18.052149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:27:18.052149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:18.052324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:18.052397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 549/1099] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:18.057561 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:18.088020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 551/1100] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 04:27:18.093948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:18.157692 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd07d53-1a93-46ac-9672-6f4a75173556 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.191558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.191809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c899a6-ad2c-4d76-a5b6-6304875900be None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.192158 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.192436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.192703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.193331 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:18.193629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.194994 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.207141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 550/1101] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:18.212725 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:18.229688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.230377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.230655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.230920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.232075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=9145487f4c134ed08d2989de6852002b)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.233503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.235248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 552/1102] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:18 2022] GET /identity/v3/projects/9145487f4c134ed08d2989de6852002b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:18.241273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:18.242253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:18.277721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:18.314408 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525b362-f761-46a8-acd4-fed012d552f5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.341292 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db936-50ca-48d3-b639-3a80ce887fc4 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.348586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.349210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.349489 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.349765 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.356632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.358084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:27:18.370243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:18.371189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:18.372108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 551/1103] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:27:18.374173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.374768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.375044 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.375343 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.376075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=9145487f4c134ed08d2989de6852002b, user.id=857307f5f1e2468f96e930298d9234f0) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:18.376363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.377281 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:18.377855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.383775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 553/1104] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:18 2022] GET /identity/v3/role_assignments?user.id=857307f5f1e2468f96e930298d9234f0&scope.project.id=9145487f4c134ed08d2989de6852002b&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:18.469043 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:18.485289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ca1a-9713-4733-95c2-d10c82e5147b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.521150 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.521773 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.522050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.522322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.523023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:18.523354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.524819 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04115f-a701-4ca5-be96-23e66b3f0f70 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.537999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 552/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:18.545120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:18.645984 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:18.649233 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13616fa-999b-453f-a245-2359ea1a4e0e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:18.684884 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:18.685479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:18.685752 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:18.686018 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:18.686728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] RBAC: Adding query filter params (role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=d2fb8c8ee6324e4ba6c328a9c2450fde) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:18.687029 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:18.688484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138facd6-4c9f-4a72-bb74-1efb8fa3b3f3 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:18.694316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 554/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:18 2022] GET /identity/v3/role_assignments?user.id=d2fb8c8ee6324e4ba6c328a9c2450fde&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=b2b8b2a3bdb948f49b74eec4d7ee5a34 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:20.565890 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d996a-dbae-4eb6-ba0c-e9ab1509cfb8 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:20.566402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d996a-dbae-4eb6-ba0c-e9ab1509cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:20.566402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d996a-dbae-4eb6-ba0c-e9ab1509cfb8 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:20.567716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 553/1107] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:20.573428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:20.573870 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:20.573962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:20.592235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:20.593394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:20.657086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 555/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:20.925095 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d996a-dbae-4eb6-ba0c-e9ab1509cfb8 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:21.024405 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d996a-dbae-4eb6-ba0c-e9ab1509cfb8 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:21.057390 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8320d-4c3d-4af0-8f26-bfa95c35c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:21.058003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8320d-4c3d-4af0-8f26-bfa95c35c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:21.058280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8320d-4c3d-4af0-8f26-bfa95c35c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:21.058549 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8320d-4c3d-4af0-8f26-bfa95c35c8cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:21.059920 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8320d-4c3d-4af0-8f26-bfa95c35c8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:21.061350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8320d-4c3d-4af0-8f26-bfa95c35c8cc None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:21.062875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 554/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:21.068441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:21.158427 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:21.165144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509d44-fbbe-4031-af4e-dde347607109 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:21.198872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268b2da-c7d0-4dde-b309-becb6afb4d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:21.199497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b2da-c7d0-4dde-b309-becb6afb4d5b None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:21.199776 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b2da-c7d0-4dde-b309-becb6afb4d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:21.200047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b2da-c7d0-4dde-b309-becb6afb4d5b None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:21.200685 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268b2da-c7d0-4dde-b309-becb6afb4d5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:21.202108 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268b2da-c7d0-4dde-b309-becb6afb4d5b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:21.225226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 556/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:27:21 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:23.412486 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb6ce1-d54d-4c2e-891a-57384f8f28fd None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:23.413005 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb6ce1-d54d-4c2e-891a-57384f8f28fd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:23.413123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb6ce1-d54d-4c2e-891a-57384f8f28fd None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:23.414420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 555/1111] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:23.420256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:23.420666 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:23.420812 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:23.439675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:23.440857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:23.504669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 557/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:23.776647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb6ce1-d54d-4c2e-891a-57384f8f28fd None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:23.792695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:23.877450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb6ce1-d54d-4c2e-891a-57384f8f28fd None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:23.910074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:23.910693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:23.910974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:23.911279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] PATH_INFO: `/v3/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:23.912658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] RBAC: Authorizing `identity:get_role(role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:23.914054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:23.915385 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 556/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:23 2022] GET /identity/v3/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:23.921167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:23.999545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:24.019480 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c28a31-8da0-485c-9765-b3c3f9e4c39f None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:24.051788 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:24.052350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:24.052622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:24.052888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] PATH_INFO: `/v3/users/cd970da709cf487b804f3c246d1cf194` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:24.066282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] RBAC: Authorizing `identity:get_user(user_id=cd970da709cf487b804f3c246d1cf194)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:24.067751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:24.069336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 558/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:23 2022] GET /identity/v3/users/cd970da709cf487b804f3c246d1cf194 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:24.075534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:24.155772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:24.174377 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ba0c5-912d-45cd-9500-830a5ad3bb0d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:24.207689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:24.208308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:24.208586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:24.208857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:24.280722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:24.282168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:24.360306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:24.378857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 557/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:24.385469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:24.482289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a761a74-d8ac-4cb4-a848-788fa6c4c424 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:24.515783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d61d4-6e2f-45b7-8c24-07a50fbfcb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:24.516401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d61d4-6e2f-45b7-8c24-07a50fbfcb0e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:24.516681 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d61d4-6e2f-45b7-8c24-07a50fbfcb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:24.516951 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d61d4-6e2f-45b7-8c24-07a50fbfcb0e None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:24.518057 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d61d4-6e2f-45b7-8c24-07a50fbfcb0e None admin] RBAC: Authorizing `identity:get_project(project_id=9145487f4c134ed08d2989de6852002b)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:24.519503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d61d4-6e2f-45b7-8c24-07a50fbfcb0e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:24.521100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 559/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:24 2022] GET /identity/v3/projects/9145487f4c134ed08d2989de6852002b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:24.528565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:24.628910 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861e18-c207-43f7-9253-7eb11c764836 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:24.662108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:24.662691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:24.662963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:24.663259 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:24.663963 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] RBAC: Adding query filter params (role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=9145487f4c134ed08d2989de6852002b, user.id=cd970da709cf487b804f3c246d1cf194) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:24.664263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:24.665682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c11407-f1c6-4e9f-8134-a83c99651d77 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:24.671152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 558/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:24 2022] GET /identity/v3/role_assignments?user.id=cd970da709cf487b804f3c246d1cf194&scope.project.id=9145487f4c134ed08d2989de6852002b&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:26.769557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec7c3-0a7c-4813-bc90-17e3c9e922f1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:26.770117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec7c3-0a7c-4813-bc90-17e3c9e922f1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:26.770117 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec7c3-0a7c-4813-bc90-17e3c9e922f1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:26.771445 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 560/1118] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:26.776547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:26.776944 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:26.777093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:26.795365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:26.796533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:26.837400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:26.861294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 559/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:27.127517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec7c3-0a7c-4813-bc90-17e3c9e922f1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:27.136393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:27.226495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec7c3-0a7c-4813-bc90-17e3c9e922f1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:27.258780 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:27.259416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:27.260228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:27.260494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] PATH_INFO: `/v3/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:27.261848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] RBAC: Authorizing `identity:get_role(role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:27.263220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:27.264501 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 561/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:27 2022] GET /identity/v3/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:27.270234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:27.382121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f88535-a8ae-4c09-a7f7-6763713c38af None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:27.415416 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:27.416051 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:27.416321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:27.416587 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] PATH_INFO: `/v3/users/cd970da709cf487b804f3c246d1cf194` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:27.417688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cd970da709cf487b804f3c246d1cf194)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:27.419137 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:27.420804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 560/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:27 2022] GET /identity/v3/users/cd970da709cf487b804f3c246d1cf194 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:27.426586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:27.499296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:27.524387 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190033-fe19-4c1d-a73d-14e8ce62daa2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:27.558094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260789f6-79fc-4359-84da-6858e42e66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:27.558707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260789f6-79fc-4359-84da-6858e42e66de None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:27.558989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260789f6-79fc-4359-84da-6858e42e66de None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:27.559557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260789f6-79fc-4359-84da-6858e42e66de None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:27.560672 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260789f6-79fc-4359-84da-6858e42e66de None admin] RBAC: Authorizing `identity:get_project(project_id=9145487f4c134ed08d2989de6852002b)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:27.562083 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260789f6-79fc-4359-84da-6858e42e66de None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:27.563704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 562/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:27 2022] GET /identity/v3/projects/9145487f4c134ed08d2989de6852002b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:27.569674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:27.614002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:27.666838 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ecc1-3c30-4224-872f-9365066337a8 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:27.700209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd8b7b-2722-4ae3-b4c4-1bc691fae20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:27.700854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8b7b-2722-4ae3-b4c4-1bc691fae20a None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:27.701132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8b7b-2722-4ae3-b4c4-1bc691fae20a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:27.701401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd8b7b-2722-4ae3-b4c4-1bc691fae20a None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b/users/cd970da709cf487b804f3c246d1cf194/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:27.703516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd8b7b-2722-4ae3-b4c4-1bc691fae20a None admin] RBAC: Authorizing `identity:create_grant(project_id=9145487f4c134ed08d2989de6852002b, user_id=cd970da709cf487b804f3c246d1cf194, role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:27.704938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd8b7b-2722-4ae3-b4c4-1bc691fae20a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:27.716859 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 561/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:27:27 2022] PUT /identity/v3/projects/9145487f4c134ed08d2989de6852002b/users/cd970da709cf487b804f3c246d1cf194/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:27:29.837029 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba461-24a2-41d0-8be9-5d60e3daebbb None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:29.838109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba461-24a2-41d0-8be9-5d60e3daebbb None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:29.838109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba461-24a2-41d0-8be9-5d60e3daebbb None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:29.839822 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 563/1124] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:29.845071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:29.845458 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:29.845615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:29.863932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:29.865108 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:29.929335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 562/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:30.198405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bba461-24a2-41d0-8be9-5d60e3daebbb None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:30.297550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bba461-24a2-41d0-8be9-5d60e3daebbb None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:30.332451 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:30.333078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:30.333355 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:30.333623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] PATH_INFO: `/v3/roles/c8a317bbaea94b1f99068f388c4b3310` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:30.335497 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] RBAC: Authorizing `identity:get_role(role_id=c8a317bbaea94b1f99068f388c4b3310)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:30.336839 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:30.338222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 564/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:30 2022] GET /identity/v3/roles/c8a317bbaea94b1f99068f388c4b3310 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:30.344084 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:30.378594 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:30.443953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebf3cf-a803-40b1-a664-b3f9420a253b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:30.476735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:30.477292 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:30.477566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:30.477834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] PATH_INFO: `/v3/users/cd970da709cf487b804f3c246d1cf194` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:30.479702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] RBAC: Authorizing `identity:get_user(user_id=cd970da709cf487b804f3c246d1cf194)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:30.481130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:30.482660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 563/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:30 2022] GET /identity/v3/users/cd970da709cf487b804f3c246d1cf194 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:30.488436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:30.501390 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:30.586137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3391-a679-4bb3-a164-657064063b1f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:30.621558 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46751a91-217a-494d-95b5-a62767474329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:30.622457 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751a91-217a-494d-95b5-a62767474329 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:30.622731 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751a91-217a-494d-95b5-a62767474329 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:30.622998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751a91-217a-494d-95b5-a62767474329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:30.686746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46751a91-217a-494d-95b5-a62767474329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:30.688178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46751a91-217a-494d-95b5-a62767474329 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:30.698841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:30.782991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 565/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:30.788964 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:30.886605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70067-a609-4d1b-8c7c-013251a3afac None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:30.888124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:30.920950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4d5c4-b90a-4256-a511-0d28c5feb870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:30.921564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d5c4-b90a-4256-a511-0d28c5feb870 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:30.921836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d5c4-b90a-4256-a511-0d28c5feb870 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:30.922106 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d5c4-b90a-4256-a511-0d28c5feb870 None admin] PATH_INFO: `/v3/projects/9145487f4c134ed08d2989de6852002b` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:30.923227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4d5c4-b90a-4256-a511-0d28c5feb870 None admin] RBAC: Authorizing `identity:get_project(project_id=9145487f4c134ed08d2989de6852002b)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:30.924690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4d5c4-b90a-4256-a511-0d28c5feb870 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:30.926313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 564/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:30 2022] GET /identity/v3/projects/9145487f4c134ed08d2989de6852002b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:30.933301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46751a91-217a-494d-95b5-a62767474329 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:31.028909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46751a91-217a-494d-95b5-a62767474329 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:31.039957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:31.064545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:31.065132 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:31.065408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:31.065677 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:31.066391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] RBAC: Adding query filter params (role.id=c8a317bbaea94b1f99068f388c4b3310, scope.project.id=9145487f4c134ed08d2989de6852002b, user.id=cd970da709cf487b804f3c246d1cf194) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:31.066692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:31.068128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db7dee-2685-4197-97ba-2b6fd0cbb316 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:31.073856 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 566/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:30 2022] GET /identity/v3/role_assignments?user.id=cd970da709cf487b804f3c246d1cf194&scope.project.id=9145487f4c134ed08d2989de6852002b&role.id=c8a317bbaea94b1f99068f388c4b3310 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:33.230836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ef84f-f061-4540-9739-b21f63092252 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:33.231409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ef84f-f061-4540-9739-b21f63092252 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:33.231409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ef84f-f061-4540-9739-b21f63092252 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:33.232714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 565/1131] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:33.237989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:33.238378 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:33.238609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:33.256705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:33.257867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:33.323522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 567/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:33.594058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ef84f-f061-4540-9739-b21f63092252 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:33.692929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ef84f-f061-4540-9739-b21f63092252 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:33.725768 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3211f-6e68-4d22-8479-f94b7a85dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:33.726379 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3211f-6e68-4d22-8479-f94b7a85dab6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:33.726650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3211f-6e68-4d22-8479-f94b7a85dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:33.726915 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3211f-6e68-4d22-8479-f94b7a85dab6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:33.728082 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3211f-6e68-4d22-8479-f94b7a85dab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:33.729803 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3211f-6e68-4d22-8479-f94b7a85dab6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:33.731349 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 566/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:33.737055 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:33.832215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d54846-83a0-4340-89a4-1d56d8fa8722 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:33.834422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:33.864578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae835ae8-af35-4302-ae69-e88a8622ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:33.865107 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae835ae8-af35-4302-ae69-e88a8622ec92 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:33.865381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae835ae8-af35-4302-ae69-e88a8622ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:33.865648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae835ae8-af35-4302-ae69-e88a8622ec92 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:33.866277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae835ae8-af35-4302-ae69-e88a8622ec92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:33.867717 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae835ae8-af35-4302-ae69-e88a8622ec92 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:33.894096 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 568/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:27:33 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:36.066688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d21b6-d7a1-4980-a905-8eef10d67cd2 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:36.067238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d21b6-d7a1-4980-a905-8eef10d67cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:36.067332 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d21b6-d7a1-4980-a905-8eef10d67cd2 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:36.068591 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 567/1135] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:36.074109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:36.074527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:36.074654 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:36.093017 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:36.094199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:36.158490 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 569/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:27:36.440359 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d21b6-d7a1-4980-a905-8eef10d67cd2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:36.480776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:36.540076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d21b6-d7a1-4980-a905-8eef10d67cd2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:36.573637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694873-974d-4c32-8f9e-dd5c4c223fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:36.574253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694873-974d-4c32-8f9e-dd5c4c223fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:36.574530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694873-974d-4c32-8f9e-dd5c4c223fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:36.574798 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694873-974d-4c32-8f9e-dd5c4c223fc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:36.575921 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694873-974d-4c32-8f9e-dd5c4c223fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:36.577345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694873-974d-4c32-8f9e-dd5c4c223fc5 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:36.578869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 568/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:36.584557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:36.665211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:36.680319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b00f-f063-4078-9e34-d7a4ec55c909 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:36.713800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e05ad0-b011-4600-a0b6-4ae22ec02b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:36.714390 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05ad0-b011-4600-a0b6-4ae22ec02b4f None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:36.714664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05ad0-b011-4600-a0b6-4ae22ec02b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:36.714934 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05ad0-b011-4600-a0b6-4ae22ec02b4f None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:36.715693 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e05ad0-b011-4600-a0b6-4ae22ec02b4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:36.717103 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e05ad0-b011-4600-a0b6-4ae22ec02b4f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:36.736742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 570/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:27:36 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:27:38.903935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aade0-57cc-4f7f-854a-70b53e45bf54 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:38.904452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aade0-57cc-4f7f-854a-70b53e45bf54 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:38.904452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aade0-57cc-4f7f-854a-70b53e45bf54 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:38.905797 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 569/1139] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:38.911036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:38.911434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:38.911612 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:38.929749 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:38.930911 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:38.994957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 571/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:39.263057 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aade0-57cc-4f7f-854a-70b53e45bf54 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:39.364653 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aade0-57cc-4f7f-854a-70b53e45bf54 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:39.371968 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:39.398501 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:39.399134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:39.399411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:39.399703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:39.410177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:39.414889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:39.415995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:39.417015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 570/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:39.422337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:39.490651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:39.528738 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66215c5e-63f3-44c8-8415-60a94cd831cf None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:39.562652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:39.563283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:39.563561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:39.563831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:39.564482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:39.564779 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:39.566122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:39.574686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 572/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:27:39.580722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:39.679136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff4b14-60cb-47c5-af1c-caaa65d3628d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:39.711925 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:39.713135 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:39.713297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:39.713564 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] PATH_INFO: `/v3/users/795cca8a53474e8b9d117b2f93fb258f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:39.726100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] RBAC: Authorizing `identity:get_user(user_id=795cca8a53474e8b9d117b2f93fb258f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:39.727571 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:39.729701 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 571/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:39 2022] GET /identity/v3/users/795cca8a53474e8b9d117b2f93fb258f => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:39.735362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:39.831324 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaf238-f604-4154-81cb-1880aaebe140 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:39.864099 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:39.864687 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:39.864965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:39.865236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:39.867734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:39.930860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:39.932382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:40.027224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 573/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:40.033116 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:40.057672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:40.131918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6a0e1-5f1c-4d98-b3a9-f5c0e3c55e98 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:40.165635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c5c58-7fb0-4a35-b8f5-57d488cf7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:40.166248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c5c58-7fb0-4a35-b8f5-57d488cf7b85 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:40.166529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c5c58-7fb0-4a35-b8f5-57d488cf7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:40.166804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c5c58-7fb0-4a35-b8f5-57d488cf7b85 None admin] PATH_INFO: `/v3/projects/d7758ddf06c94d03943ffdfe73fe2131` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:40.167941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c5c58-7fb0-4a35-b8f5-57d488cf7b85 None admin] RBAC: Authorizing `identity:get_project(project_id=d7758ddf06c94d03943ffdfe73fe2131)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:40.169381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c5c58-7fb0-4a35-b8f5-57d488cf7b85 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:40.170974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 572/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:40 2022] GET /identity/v3/projects/d7758ddf06c94d03943ffdfe73fe2131 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:40.177030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:40.209830 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:40.273844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df991-d27a-4ccf-a7dd-2913ea663d89 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:40.307085 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:40.307695 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:40.307969 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:40.308237 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:40.308945 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=d7758ddf06c94d03943ffdfe73fe2131, user.id=795cca8a53474e8b9d117b2f93fb258f) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:40.309248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:40.310912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1715f23-6f29-42c8-abda-70196953b185 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:40.316091 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 574/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:40 2022] GET /identity/v3/role_assignments?user.id=795cca8a53474e8b9d117b2f93fb258f&scope.project.id=d7758ddf06c94d03943ffdfe73fe2131&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:42.427373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783859e-653d-4db3-9410-27321678f8a2 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:42.427890 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783859e-653d-4db3-9410-27321678f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:42.427978 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783859e-653d-4db3-9410-27321678f8a2 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:42.429233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 573/1147] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:42.434577 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c7920-192d-44c3-915f-91546888dad1 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:42.434978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c7920-192d-44c3-915f-91546888dad1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:42.435162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c7920-192d-44c3-915f-91546888dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:42.453488 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-239c7920-192d-44c3-915f-91546888dad1 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:42.454648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-239c7920-192d-44c3-915f-91546888dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:42.520063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 575/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:42.787706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783859e-653d-4db3-9410-27321678f8a2 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:42.877825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:42.887881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783859e-653d-4db3-9410-27321678f8a2 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:42.921254 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:42.921966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:42.922248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:42.922516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:42.932693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:42.937743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:42.938831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:42.940038 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 574/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:42.944850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c7920-192d-44c3-915f-91546888dad1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:42.972503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:43.042436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c7920-192d-44c3-915f-91546888dad1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:43.075346 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:43.075940 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:43.076216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:43.076487 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:43.077141 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:43.077442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:43.078810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:43.086684 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 576/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:43.092654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:43.190474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5e27-a3b3-494c-8959-90b599019922 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:43.222911 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:43.223554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:43.223834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:43.224105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] PATH_INFO: `/v3/users/795cca8a53474e8b9d117b2f93fb258f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:43.225209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] RBAC: Authorizing `identity:get_user(user_id=795cca8a53474e8b9d117b2f93fb258f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:43.226637 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:43.228850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 575/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:43 2022] GET /identity/v3/users/795cca8a53474e8b9d117b2f93fb258f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:43.234601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:43.322868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:43.332410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eba0a-390f-46d3-a27e-1f886abc4a25 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:43.365195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8c4b6-6007-4cc3-a12e-563e753b283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:43.365800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c4b6-6007-4cc3-a12e-563e753b283a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:43.366078 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c4b6-6007-4cc3-a12e-563e753b283a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:43.366347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c4b6-6007-4cc3-a12e-563e753b283a None admin] PATH_INFO: `/v3/projects/d7758ddf06c94d03943ffdfe73fe2131` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:43.367449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8c4b6-6007-4cc3-a12e-563e753b283a None admin] RBAC: Authorizing `identity:get_project(project_id=d7758ddf06c94d03943ffdfe73fe2131)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:43.368997 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8c4b6-6007-4cc3-a12e-563e753b283a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:43.370568 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 577/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:43 2022] GET /identity/v3/projects/d7758ddf06c94d03943ffdfe73fe2131 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:43.376491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:43.397555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:43.473816 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631e7d-1045-4c13-8459-77a51b65d795 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:43.506534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcbcc6-6412-44d8-ac0c-ce3724a48f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:43.507205 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcbcc6-6412-44d8-ac0c-ce3724a48f29 None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:43.507484 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcbcc6-6412-44d8-ac0c-ce3724a48f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:43.507755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcbcc6-6412-44d8-ac0c-ce3724a48f29 None admin] PATH_INFO: `/v3/projects/d7758ddf06c94d03943ffdfe73fe2131/users/795cca8a53474e8b9d117b2f93fb258f/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:43.509682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcbcc6-6412-44d8-ac0c-ce3724a48f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7758ddf06c94d03943ffdfe73fe2131, user_id=795cca8a53474e8b9d117b2f93fb258f, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:43.511111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcbcc6-6412-44d8-ac0c-ce3724a48f29 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:43.523399 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 576/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:27:43 2022] PUT /identity/v3/projects/d7758ddf06c94d03943ffdfe73fe2131/users/795cca8a53474e8b9d117b2f93fb258f/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:27:45.648712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72c725-4df2-44c5-8f74-a1d4ce7bf224 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:45.649316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72c725-4df2-44c5-8f74-a1d4ce7bf224 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:45.649316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72c725-4df2-44c5-8f74-a1d4ce7bf224 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:45.650499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 578/1154] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:45.655791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:45.656240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:45.656348 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:45.674157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:45.675370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:45.741950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 577/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:46.016859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72c725-4df2-44c5-8f74-a1d4ce7bf224 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:46.116126 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72c725-4df2-44c5-8f74-a1d4ce7bf224 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:46.148353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:46.148963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:46.149241 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:46.150041 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:46.160265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:27:46.164993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:46.166267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:27:46.167235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 579/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:46.172112 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:46.183698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:46.273166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd959-9670-4431-956f-542d38e466ee None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:46.307007 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:46.307624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:46.307899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:46.308169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:46.308825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:46.309121 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:46.310738 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:46.318440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 578/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:46.325074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:46.343788 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:46.422897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac9caa-f4fa-4426-bfff-7e8102cc4c58 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:46.456303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:46.456923 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:46.457201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:46.457472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] PATH_INFO: `/v3/users/795cca8a53474e8b9d117b2f93fb258f` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:46.458566 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] RBAC: Authorizing `identity:get_user(user_id=795cca8a53474e8b9d117b2f93fb258f)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:46.460011 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:46.461555 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 580/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:27:46 2022] GET /identity/v3/users/795cca8a53474e8b9d117b2f93fb258f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:46.467447 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:46.536028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:46.566056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e104162-6e4c-4127-9360-0f1dcf074b59 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:46.598273 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:46.598862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:46.599170 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:46.599442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:46.663605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:46.665557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:46.731673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:46.761318 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 579/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:46.767339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:46.849368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:46.864680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c24d-c571-4b00-aa15-6ca7c726367a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:46.898397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ee8a-c88f-4cc2-b032-7f3381d509d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:46.899004 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ee8a-c88f-4cc2-b032-7f3381d509d4 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:46.899303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ee8a-c88f-4cc2-b032-7f3381d509d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:46.899641 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ee8a-c88f-4cc2-b032-7f3381d509d4 None admin] PATH_INFO: `/v3/projects/d7758ddf06c94d03943ffdfe73fe2131` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:46.900990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ee8a-c88f-4cc2-b032-7f3381d509d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d7758ddf06c94d03943ffdfe73fe2131)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:46.902401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ee8a-c88f-4cc2-b032-7f3381d509d4 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:46.904011 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 581/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:27:46 2022] GET /identity/v3/projects/d7758ddf06c94d03943ffdfe73fe2131 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:46.910178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:47.007398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598b51-26bd-46ba-964d-04b6134dce06 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:47.041028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:47.041624 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:47.041904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:47.042178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:47.042898 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=d7758ddf06c94d03943ffdfe73fe2131, user.id=795cca8a53474e8b9d117b2f93fb258f) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:47.043237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:47.044669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5595f5-c903-48c2-8844-b368859c16f7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:47.050241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 580/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:27:46 2022] GET /identity/v3/role_assignments?user.id=795cca8a53474e8b9d117b2f93fb258f&scope.project.id=d7758ddf06c94d03943ffdfe73fe2131&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:49.251348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce00c-44d6-4c70-abe4-a2cf449402fa None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:49.251813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce00c-44d6-4c70-abe4-a2cf449402fa None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:49.251913 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce00c-44d6-4c70-abe4-a2cf449402fa None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:49.253206 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 582/1162] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:49.258400 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:49.258818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:49.259041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:49.277550 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:49.278739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:49.307984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:49.345680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 581/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:49.614716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce00c-44d6-4c70-abe4-a2cf449402fa None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:49.714907 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce00c-44d6-4c70-abe4-a2cf449402fa None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:49.747575 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:49.748170 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:49.748448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:49.748718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:49.771298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:49.814267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:49.815724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:49.909436 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 583/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:27:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:27:49.915953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:50.014703 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2265c-be8c-4c11-8e51-b46d1655c8e0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:50.050757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:50.051398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:50.051671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:50.051940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:50.058693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:50.060424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-44ebd8df-9927-43af-a672-498033318f8e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:27:50.072515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:27:50.073717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:27:50.074744 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 582/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:27:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:27:50.079576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:50.132619 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:50.176475 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319d23-f128-4225-809f-584504dc9af2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:50.209088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:50.209680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:50.209958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:50.210226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:50.210863 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:27:50.211188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:50.213314 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be4549-9b95-4019-bd8e-4792db27f637 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:50.221107 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 584/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 9 04:27:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:52.339529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f32c6-f817-4020-86c7-7ee31fa63bbc None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:52.340080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f32c6-f817-4020-86c7-7ee31fa63bbc None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:52.340080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f32c6-f817-4020-86c7-7ee31fa63bbc None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:52.341409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 583/1167] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:52.346554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b6c2-711c-4b4b-979c-5a358c870f9d None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:52.346977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b6c2-711c-4b4b-979c-5a358c870f9d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:52.347125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b6c2-711c-4b4b-979c-5a358c870f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:52.365481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-2750b6c2-711c-4b4b-979c-5a358c870f9d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:52.366653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2750b6c2-711c-4b4b-979c-5a358c870f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:52.431854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 585/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:52.699060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f32c6-f817-4020-86c7-7ee31fa63bbc None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:52.725996 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:52.799277 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f32c6-f817-4020-86c7-7ee31fa63bbc None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:52.832215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94affa79-794e-4652-8c24-ef19e3b54739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:52.832810 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94affa79-794e-4652-8c24-ef19e3b54739 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:52.833088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94affa79-794e-4652-8c24-ef19e3b54739 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:52.833360 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94affa79-794e-4652-8c24-ef19e3b54739 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:52.834025 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94affa79-794e-4652-8c24-ef19e3b54739 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:52.835430 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94affa79-794e-4652-8c24-ef19e3b54739 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:52.850680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 584/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Fri Sep 9 04:27:52 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:55.025885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535866-7324-4c37-a12d-105db580330a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:55.026450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535866-7324-4c37-a12d-105db580330a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:55.026450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535866-7324-4c37-a12d-105db580330a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:55.027767 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 586/1170] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:55.032892 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:55.033268 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:55.033440 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:55.051965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:55.053136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:55.123275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 585/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:55.398998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535866-7324-4c37-a12d-105db580330a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:55.448968 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:55.500359 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535866-7324-4c37-a12d-105db580330a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:55.533356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacb0a6-c8fd-4ccb-82bb-f728734b0283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:55.533971 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb0a6-c8fd-4ccb-82bb-f728734b0283 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:55.534251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb0a6-c8fd-4ccb-82bb-f728734b0283 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:55.534523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb0a6-c8fd-4ccb-82bb-f728734b0283 None admin] PATH_INFO: `/v3/domains/8bc7048848cc4da3aab33be310e68ca2` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:55.544669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacb0a6-c8fd-4ccb-82bb-f728734b0283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8bc7048848cc4da3aab33be310e68ca2)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:55.546106 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacb0a6-c8fd-4ccb-82bb-f728734b0283 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:55.547698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 587/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Fri Sep 9 04:27:55 2022] GET /identity/v3/domains/8bc7048848cc4da3aab33be310e68ca2 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:55.553600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:55.572166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:55.652133 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd2a96-7286-45d6-bf59-d868c3bf9f43 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:55.685570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c6f53-1fb6-42bf-8ae6-76f01d235436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:55.686163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c6f53-1fb6-42bf-8ae6-76f01d235436 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:55.686438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c6f53-1fb6-42bf-8ae6-76f01d235436 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:55.686706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c6f53-1fb6-42bf-8ae6-76f01d235436 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:55.687365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c6f53-1fb6-42bf-8ae6-76f01d235436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:55.688798 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c6f53-1fb6-42bf-8ae6-76f01d235436 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:55.713712 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 586/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:27:55 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:27:57.881239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb2c7-4c85-4d8e-a388-9a37daa18582 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:57.881771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb2c7-4c85-4d8e-a388-9a37daa18582 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:57.881771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb2c7-4c85-4d8e-a388-9a37daa18582 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:57.883128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 588/1174] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:27:57.888383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:57.888779 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:57.888938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:57.907249 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:27:57.908424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:27:57.968630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:57.974682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 587/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:27:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:27:58.248871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb2c7-4c85-4d8e-a388-9a37daa18582 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:58.361807 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb2c7-4c85-4d8e-a388-9a37daa18582 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:58.372199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:27:58.402127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cf118-347b-495f-862e-dfecd20707dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:58.402750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf118-347b-495f-862e-dfecd20707dc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:58.403026 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf118-347b-495f-862e-dfecd20707dc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:58.403323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf118-347b-495f-862e-dfecd20707dc None admin] PATH_INFO: `/v3/domains/8bc7048848cc4da3aab33be310e68ca2` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:58.404432 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cf118-347b-495f-862e-dfecd20707dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=8bc7048848cc4da3aab33be310e68ca2)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:58.405880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cf118-347b-495f-862e-dfecd20707dc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:58.407483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 589/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Fri Sep 9 04:27:58 2022] GET /identity/v3/domains/8bc7048848cc4da3aab33be310e68ca2 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:27:58.413375 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:27:58.523605 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bf95-68e5-4e07-a1f4-f81b61254370 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:27:58.560257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddc9bc-ae22-4438-be40-aef28a000816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:27:58.560870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc9bc-ae22-4438-be40-aef28a000816 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:27:58.561148 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc9bc-ae22-4438-be40-aef28a000816 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:27:58.561417 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc9bc-ae22-4438-be40-aef28a000816 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:27:58.562075 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddc9bc-ae22-4438-be40-aef28a000816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:27:58.563546 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddc9bc-ae22-4438-be40-aef28a000816 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:27:58.588495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 588/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:27:58 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 04:28:00.844220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa208418-4caf-43f9-8e7c-ccf811cb22eb None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:00.844745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa208418-4caf-43f9-8e7c-ccf811cb22eb None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:00.844745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa208418-4caf-43f9-8e7c-ccf811cb22eb None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:00.846101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 590/1178] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:28:00.851373 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bda16-bb01-4373-b8b3-df620471542d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:00.851767 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bda16-bb01-4373-b8b3-df620471542d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:00.851925 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bda16-bb01-4373-b8b3-df620471542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:00.870555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-305bda16-bb01-4373-b8b3-df620471542d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:28:00.871764 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-305bda16-bb01-4373-b8b3-df620471542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:28:00.920801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:00.938617 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 589/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:28:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:28:01.214371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa208418-4caf-43f9-8e7c-ccf811cb22eb None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:01.314955 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa208418-4caf-43f9-8e7c-ccf811cb22eb None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:01.347888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:01.348494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:01.348769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:01.349035 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:01.360148 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:28:01.364799 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:28:01.365860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:28:01.366890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 591/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:28:01.373192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bda16-bb01-4373-b8b3-df620471542d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:01.469662 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bda16-bb01-4373-b8b3-df620471542d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:01.503411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:01.504011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:01.504289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:01.504558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:01.505213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:28:01.505513 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:01.506880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:01.515397 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 590/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:01.521322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:01.554986 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:01.618712 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc253-e4b9-48ec-89aa-fb445977a0be None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:01.650985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:01.651634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:01.651914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:01.652185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] PATH_INFO: `/v3/users/77fd10f58fc240d2bec74bededb7a461` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:01.665652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] RBAC: Authorizing `identity:get_user(user_id=77fd10f58fc240d2bec74bededb7a461)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:01.667101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:01.668674 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 592/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:28:01 2022] GET /identity/v3/users/77fd10f58fc240d2bec74bededb7a461 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:01.674438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:01.720601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:01.774529 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762979-557e-4e6b-a5c9-4a4c960b8ed4 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:01.808069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:01.808666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:01.808940 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:01.809206 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:01.874044 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:01.875524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:01.918501 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:01.970745 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 591/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:28:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:28:01.976666 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:02.068211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:02.075762 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34912f3-5274-4e4d-9499-606eb43ba375 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:02.109439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d7df4-03ea-40b9-b3e3-0beb4b895ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:02.110060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d7df4-03ea-40b9-b3e3-0beb4b895ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:02.110340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d7df4-03ea-40b9-b3e3-0beb4b895ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:02.110608 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d7df4-03ea-40b9-b3e3-0beb4b895ae7 None admin] PATH_INFO: `/v3/projects/e400b63f08ac441eb16af3da0c29d970` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:02.111718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d7df4-03ea-40b9-b3e3-0beb4b895ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=e400b63f08ac441eb16af3da0c29d970)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:02.113132 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d7df4-03ea-40b9-b3e3-0beb4b895ae7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:02.114727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 593/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:28:01 2022] GET /identity/v3/projects/e400b63f08ac441eb16af3da0c29d970 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:02.120995 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:02.217364 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02543d5-7627-4ef9-914b-934f1e72839d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:02.250942 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:02.251566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:02.251843 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:02.252113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:02.252828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=e400b63f08ac441eb16af3da0c29d970, user.id=77fd10f58fc240d2bec74bededb7a461) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:28:02.253130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:02.254557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010ae3b-3e9d-42a1-bbfd-b4af82a94531 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:02.259992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 592/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:28:02 2022] GET /identity/v3/role_assignments?user.id=77fd10f58fc240d2bec74bededb7a461&scope.project.id=e400b63f08ac441eb16af3da0c29d970&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:04.378362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad32c-8374-413d-93ab-817c82e75ccb None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:04.378901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad32c-8374-413d-93ab-817c82e75ccb None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:04.378901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad32c-8374-413d-93ab-817c82e75ccb None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:04.380243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 594/1186] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:28:04.386093 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:04.386517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:04.386638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:04.404471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:28:04.405634 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:28:04.408337 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:04.470229 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 593/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:28:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:28:04.745905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad32c-8374-413d-93ab-817c82e75ccb None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:04.843658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad32c-8374-413d-93ab-817c82e75ccb None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:04.876841 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:04.877444 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:04.877719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:04.877986 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:04.887883 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:28:04.892583 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:28:04.893742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:28:04.894561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 595/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:28:04.899683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:04.996639 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b499-b413-41db-a51e-919fcd3c5d26 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:05.029296 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:05.029889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:05.030168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:05.030439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:05.031119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:28:05.031420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:05.032782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:05.041193 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 594/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:05.047552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:05.071527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:05.144894 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8ad10-a386-41b4-95af-066f024098b0 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:05.178487 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:05.179120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:05.179411 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:05.179682 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] PATH_INFO: `/v3/users/77fd10f58fc240d2bec74bededb7a461` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:05.180861 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] RBAC: Authorizing `identity:get_user(user_id=77fd10f58fc240d2bec74bededb7a461)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:05.182275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:05.183874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 596/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:28:05 2022] GET /identity/v3/users/77fd10f58fc240d2bec74bededb7a461 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:05.189849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:05.192713 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:05.288275 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853623-69c6-464c-8903-24a044f11244 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:05.320790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb8081-f6e8-4348-b372-ce77e47db51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:05.321409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb8081-f6e8-4348-b372-ce77e47db51e None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:05.321687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb8081-f6e8-4348-b372-ce77e47db51e None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:05.321960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb8081-f6e8-4348-b372-ce77e47db51e None admin] PATH_INFO: `/v3/projects/e400b63f08ac441eb16af3da0c29d970` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:05.323058 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb8081-f6e8-4348-b372-ce77e47db51e None admin] RBAC: Authorizing `identity:get_project(project_id=e400b63f08ac441eb16af3da0c29d970)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:05.324518 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb8081-f6e8-4348-b372-ce77e47db51e None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:05.326115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 595/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:28:05 2022] GET /identity/v3/projects/e400b63f08ac441eb16af3da0c29d970 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:05.332189 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:05.420461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:05.430219 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c649b0-16b7-45f5-9cdd-e5675e28a184 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:05.464211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5be54-873b-49a2-973d-3b5131e83824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:05.464848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5be54-873b-49a2-973d-3b5131e83824 None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:05.465124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5be54-873b-49a2-973d-3b5131e83824 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:05.465390 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5be54-873b-49a2-973d-3b5131e83824 None admin] PATH_INFO: `/v3/projects/e400b63f08ac441eb16af3da0c29d970/users/77fd10f58fc240d2bec74bededb7a461/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:05.467263 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5be54-873b-49a2-973d-3b5131e83824 None admin] RBAC: Authorizing `identity:create_grant(project_id=e400b63f08ac441eb16af3da0c29d970, user_id=77fd10f58fc240d2bec74bededb7a461, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:05.468680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5be54-873b-49a2-973d-3b5131e83824 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:05.480503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 597/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:28:05 2022] PUT /identity/v3/projects/e400b63f08ac441eb16af3da0c29d970/users/77fd10f58fc240d2bec74bededb7a461/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:28:07.610389 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636bf7e-dac1-41e6-8a3d-05a949eacea4 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:07.610916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636bf7e-dac1-41e6-8a3d-05a949eacea4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:07.610916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636bf7e-dac1-41e6-8a3d-05a949eacea4 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:07.612213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 596/1193] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:28:07.618093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:07.618461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:07.618728 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:07.637013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:28:07.638197 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:28:07.702825 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 598/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:28:07.975351 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636bf7e-dac1-41e6-8a3d-05a949eacea4 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:08.044610 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:08.076029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636bf7e-dac1-41e6-8a3d-05a949eacea4 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:08.108674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:08.109283 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:08.109555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:08.109820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:08.119975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:28:08.124684 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:28:08.125762 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:28:08.126817 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 597/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:28:08.131901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:08.209924 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:08.229844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5cdc8-7b93-4c08-8c36-131ef26b3cc6 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:08.263406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:08.263999 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:08.264276 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:08.264544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:08.265205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:28:08.265505 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:08.266856 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:08.274798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 599/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:08.280891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:08.378312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d147f-7ecf-4a4f-b7d5-c32dbdbe5302 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:08.405450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:08.411257 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:08.411875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:08.412151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:08.412420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] PATH_INFO: `/v3/users/77fd10f58fc240d2bec74bededb7a461` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:08.413512 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=77fd10f58fc240d2bec74bededb7a461)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:08.415525 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:08.417069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 598/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 9 04:28:08 2022] GET /identity/v3/users/77fd10f58fc240d2bec74bededb7a461 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:08.422750 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:08.519745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254864b-71f5-489b-aae8-2d4429f01abc None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:08.552972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:08.553561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:08.553837 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:08.554107 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:08.565838 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:08.620134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:08.621600 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:08.716627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 600/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:28:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:28:08.722644 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:08.820090 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d6d3b-d520-41ef-8f56-ad0938b23fc0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:08.855974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da51f8-9c38-4789-ab94-4a9213903bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:08.856602 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da51f8-9c38-4789-ab94-4a9213903bcd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:08.856881 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da51f8-9c38-4789-ab94-4a9213903bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:08.857154 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da51f8-9c38-4789-ab94-4a9213903bcd None admin] PATH_INFO: `/v3/projects/e400b63f08ac441eb16af3da0c29d970` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:08.858255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da51f8-9c38-4789-ab94-4a9213903bcd None admin] RBAC: Authorizing `identity:get_project(project_id=e400b63f08ac441eb16af3da0c29d970)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:08.859739 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da51f8-9c38-4789-ab94-4a9213903bcd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:08.861350 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 599/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 9 04:28:08 2022] GET /identity/v3/projects/e400b63f08ac441eb16af3da0c29d970 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:08.867871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:28:08.909014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:08.964375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d70d05-70e0-44fb-891e-556ef9844c6a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:28:08.997115 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:28:08.997706 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:28:08.997989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:28:08.998257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:28:08.998970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=e400b63f08ac441eb16af3da0c29d970, user.id=77fd10f58fc240d2bec74bededb7a461) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:28:08.999307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:28:09.000714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6d26-d242-4178-90a1-7250e6f97926 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:28:09.006244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 601/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:28:08 2022] GET /identity/v3/role_assignments?user.id=77fd10f58fc240d2bec74bededb7a461&scope.project.id=e400b63f08ac441eb16af3da0c29d970&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:28:18.852298 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=67 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:28:19.003733 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=47 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:04.608239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4915aa-2fc6-4b84-81e6-83267f9bd1f6 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:04.608239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4915aa-2fc6-4b84-81e6-83267f9bd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:04.608239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4915aa-2fc6-4b84-81e6-83267f9bd1f6 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:04.608239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 600/1201] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:04.615714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:04.616504 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:04.616860 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:04.640816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:04.642332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:04.732071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 602/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:05.080355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4915aa-2fc6-4b84-81e6-83267f9bd1f6 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:05.218864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4915aa-2fc6-4b84-81e6-83267f9bd1f6 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:05.265985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:05.266633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:05.266945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:05.267208 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:05.279133 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:05.281117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:05.300972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:05.307558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:05.308545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:05.308545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:05.308545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:05.308545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 601/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:05.309458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:05.442590 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de237b-a8a9-4d44-986e-55438ea6fd6d None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:05.481334 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:05.488257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:05.489193 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:05.489731 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:05.489975 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:05.491424 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:05.491766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:05.493098 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e744c9-45f4-49d9-9d23-99c47ad3f5c2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:05.511147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 603/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:05.515690 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:05.582826 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:05.650648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207d3d-6919-48ad-a0a0-04a0720dca80 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:05.702533 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754f2c8-3f14-40da-ac50-0520f43a2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:05.703245 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f2c8-3f14-40da-ac50-0520f43a2c38 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:05.703523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f2c8-3f14-40da-ac50-0520f43a2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:05.703789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f2c8-3f14-40da-ac50-0520f43a2c38 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:05.704437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754f2c8-3f14-40da-ac50-0520f43a2c38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:05.705876 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754f2c8-3f14-40da-ac50-0520f43a2c38 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:05.744842 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 602/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 9 04:29:05 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:29:08.581022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee593-7882-4cd8-95d4-7bea95aed8e3 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:08.581537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee593-7882-4cd8-95d4-7bea95aed8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:08.581537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee593-7882-4cd8-95d4-7bea95aed8e3 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:08.582805 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 604/1206] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:08.589186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:08.589654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:08.589767 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:08.608656 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:08.609850 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:08.690398 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 603/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:29:08.979354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ee593-7882-4cd8-95d4-7bea95aed8e3 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:09.097208 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ee593-7882-4cd8-95d4-7bea95aed8e3 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:09.138773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:09.139737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:09.140015 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:09.140343 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:09.151707 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:29:09.156521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:09.157542 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:09.158458 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 605/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:09.164524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:09.205490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:09.277025 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1230a3f-1608-40ee-bb0d-e2b4ad8f30a0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:09.315582 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:09.316255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:09.316535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:09.316805 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:09.317472 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:09.317770 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:09.319223 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:09.327661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 604/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:29:09.334472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:09.395407 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:09.464994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004afd-a9ef-4346-ba29-bb05c0144e1e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:09.507948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:09.508537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:09.508818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:09.509089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:09.524754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:09.526499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:09.545345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:09.546389 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:09.552042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:09.552042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:09.552042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:09.552042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 606/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:09.554661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:09.661481 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:09.665772 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d107a8-93d1-41e0-96a6-8e455f80437b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:09.702859 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:09.703765 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:09.704212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:09.704632 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:09.705480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:09.705927 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:09.707476 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:09.725293 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 605/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:09.726949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:09.832409 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e706-1f4d-4557-9022-072edbc05a62 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:09.834625 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:09.870714 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:09.871821 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:09.872352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:09.872859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:09.882413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:09.884183 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:29:09.896782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:09.902836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:09.904008 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 607/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:09.904641 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:10.019895 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826f83-05ed-4a5b-ad9e-8ac9594eb30b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:10.057751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:10.058523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:10.058801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:10.059074 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:10.060089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:10.060387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:10.061908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:10.080380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 606/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 9 04:29:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:10.086378 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:10.197316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ce925-e405-41ee-81a5-b9a52056a2cf None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:10.247836 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:10.248449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:10.248729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:10.248996 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:10.284109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:10.328549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:10.330093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:10.460231 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 608/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:29:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:29:10.468105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:10.489186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:10.585087 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0e77-85f5-4566-b9ce-a8e66e593f3a None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:10.622982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:10.623813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:10.624188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:10.624468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:10.640754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:10.642231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:10.657534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:10.664538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:10.665674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:10.665674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:10.665674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:10.665674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 607/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:29:10.667429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:10.733915 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:10.786360 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca5ba1-cfd7-4013-be0f-feefbc1af856 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:10.834160 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:10.834787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:10.835069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:10.835407 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:10.836050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:10.836354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:10.837736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:10.855201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 609/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:10.856901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:10.935152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:10.967109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588179-f1be-4e83-8229-e2a006d8437b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:11.005082 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:11.005861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:11.006139 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:11.006412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:11.014236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:11.015960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:29:11.030355 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:11.031523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:11.032615 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 608/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:11.038395 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:11.154103 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce792-fb1e-429e-88af-45991307acb8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:11.182430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:11.199664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:11.200539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:11.200939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:11.201251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:11.202208 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:11.202690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:11.204965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e5e5b-ac47-48f9-b1cb-37d4eea2beae None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:11.220816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 610/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:11.224697 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:11.328312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42210aa6-4596-4076-801b-83777a8f39c2 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:11.356510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:11.363621 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:11.364396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:11.364801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:11.365669 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:11.366654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f6aae5696d46443686c84424744ec36d) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:11.367072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:11.368909 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b47f13-571a-4b5e-8a1f-53c6ce46665b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:11.376159 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 609/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:29:11 2022] GET /identity/v3/role_assignments?user.id=f6aae5696d46443686c84424744ec36d&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:13.778691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3d8cc-8693-448e-b023-180a179325fc None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:13.778691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3d8cc-8693-448e-b023-180a179325fc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:13.778691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3d8cc-8693-448e-b023-180a179325fc None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:13.778691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 611/1220] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:13.783988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:13.784368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:13.784516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:13.804101 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:13.805290 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:13.880140 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 610/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:14.175541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3d8cc-8693-448e-b023-180a179325fc None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:14.303506 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3d8cc-8693-448e-b023-180a179325fc None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:14.343831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:14.344589 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:14.344939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:14.345257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:14.358596 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:29:14.363463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:14.364629 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:14.366243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 612/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:29:14.371310 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:14.485008 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4726-e5d7-4881-a3ff-8c551fa17f44 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:14.517294 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:14.535145 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:14.536012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:14.536463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:14.536864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:14.537795 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:14.538204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:14.541144 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:14.552813 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 611/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:14.560350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:14.611114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:14.682305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a0db5-12c0-4802-8397-d27e309965b1 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:14.729195 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:14.730548 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:14.731016 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:14.731521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:14.748884 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:14.751510 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:14.777330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:14.778461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:14.779886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:14.779886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:14.779886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:14.779886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 613/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:14.785069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:14.901276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d09b45-6362-465c-bcf2-9b2299de3e6d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:14.937520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:14.938134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:14.938417 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:14.938691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:14.939404 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:14.939709 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:14.941105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:14.955867 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 612/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:14.962634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:15.067862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:15.076299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc5a90-2932-4412-822c-43780b02e32a None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:15.114125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:15.114717 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:15.115662 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:15.116004 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:15.124422 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:15.125982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:29:15.138137 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:15.139302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:15.140296 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 614/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:15.145593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:15.194771 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:15.258111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9849-2f73-4b7d-aa8f-1d91e1b71cd7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:15.293752 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:15.294361 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:15.294638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:15.294904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:15.295668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:15.295972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:15.297402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:15.315251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 613/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 9 04:29:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:15.321473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:15.434766 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f17e-2aec-45aa-b1f4-9d113179683e None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:15.471177 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:15.471815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:15.472094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:15.472362 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:15.484138 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:15.485610 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:15.508881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:15.510104 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:15.511013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:15.511013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:15.511013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:15.511013 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 615/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:15.517506 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:15.647626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925ff0f-e8a3-45df-a80e-8d4389feaa41 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:15.649984 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:15.686080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:15.686689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:15.686967 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:15.687265 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:15.687901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:15.688204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:15.689570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:15.701814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 614/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:15.708694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:15.719004 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:15.820337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc29d-7112-49fd-9350-d815c1bf2426 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:15.857938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:15.858897 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:15.859226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:15.859496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:15.868065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:15.869901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:29:15.884873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:15.885967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:15.887048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 616/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:29:15.892309 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:16.010028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31634-ed0d-4922-8f86-1bd7a8db75a7 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:16.053662 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:16.054833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:16.054833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:16.054833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:16.055523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:16.056023 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:16.057354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfb740-cbf8-458f-a11f-8225afe55046 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:16.071836 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 615/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:16.078042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:16.147374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:16.186285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf2fa-e56a-41eb-a169-1ac52fbfaaf7 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:16.219963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff63837-dd33-419c-a6d6-0d37ef2808de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:16.220623 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff63837-dd33-419c-a6d6-0d37ef2808de None admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:16.220898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff63837-dd33-419c-a6d6-0d37ef2808de None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:16.221199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff63837-dd33-419c-a6d6-0d37ef2808de None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f6aae5696d46443686c84424744ec36d/roles/e8a491bb8bb64f8a8094f089b70ae62d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:16.236239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff63837-dd33-419c-a6d6-0d37ef2808de None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=f6aae5696d46443686c84424744ec36d, role_id=e8a491bb8bb64f8a8094f089b70ae62d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:16.237664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff63837-dd33-419c-a6d6-0d37ef2808de None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:16.251185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 617/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:29:16 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f6aae5696d46443686c84424744ec36d/roles/e8a491bb8bb64f8a8094f089b70ae62d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 04:29:18.794177 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d52cf-48bb-46d4-bf7a-91181b3eb777 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:18.794774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d52cf-48bb-46d4-bf7a-91181b3eb777 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:18.794774 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d52cf-48bb-46d4-bf7a-91181b3eb777 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:18.796109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 616/1233] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:18.801392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:18.801858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:18.801965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:18.823390 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:18.824582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:18.899935 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 618/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:19.217402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d52cf-48bb-46d4-bf7a-91181b3eb777 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:19.249630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:19.342955 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d52cf-48bb-46d4-bf7a-91181b3eb777 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:19.384693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:19.385475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:19.385849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:19.386154 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:19.397908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:29:19.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:19.403902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:19.404815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 617/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 9 04:29:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:19.410187 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:19.457309 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:19.515383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724d220-637a-4504-92b5-637a38a48d0c None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:19.554609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:19.555249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:19.555531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:19.555812 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:19.556481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:19.556791 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:19.558171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:19.573660 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 619/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 9 04:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:29:19.574807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:19.666019 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:19.682988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874373d6-e4d8-45f9-9bb7-9a042c19a6d5 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:19.720490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:19.721330 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:19.721654 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:19.722003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:19.733224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:19.734811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:19.750469 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:19.751614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:19.752538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:19.752538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:19.752538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:19.752538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 618/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:19.758410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:19.875676 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5199d-2b3d-4d0a-bbca-be486fd57ac6 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:19.886133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:19.914730 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:19.915329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:19.915611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:19.915880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:19.916517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:19.916842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:19.918167 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:19.930498 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 620/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:29:19.936845 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:20.048824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc4b96-4a4b-456b-b057-41369d9f6243 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:20.092544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:20.093172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:20.093735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:20.093972 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:20.097403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:20.103594 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:20.105197 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:29:20.119868 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:20.121080 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:20.122186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 619/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:20.127598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:20.244778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360aa8-0b0b-49b8-b919-ecf518eb98ad None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:20.284846 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:20.285637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:20.285987 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:20.286330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:20.287588 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:20.287886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:20.289559 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:20.310428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 621/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 9 04:29:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:20.316393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:20.437032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f428ba-4b85-4016-9f8d-266d1cb79b53 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:20.480841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:20.481815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:20.482270 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:20.482732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:20.564269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:20.572569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:20.574036 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:20.692105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 620/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:29:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:29:20.698965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:20.733263 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:20.817323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f53f-c4f3-4323-8872-62cb9ccfa351 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:20.861449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:20.861763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:20.861918 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:20.862230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:20.874816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:20.876595 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:20.901482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:20.902598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:20.903550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:20.903550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:20.903550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:20.903550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 622/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:20.908523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:21.013667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:21.019820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c8a4f-324e-43a4-9e8e-a060478c6d61 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:21.058438 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405315-651d-4521-8752-265cada08182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:21.059466 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405315-651d-4521-8752-265cada08182 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:21.059791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405315-651d-4521-8752-265cada08182 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:21.060032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405315-651d-4521-8752-265cada08182 None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:21.060796 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405315-651d-4521-8752-265cada08182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:21.061104 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405315-651d-4521-8752-265cada08182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:21.062618 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405315-651d-4521-8752-265cada08182 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:21.076728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 621/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:21.082716 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:21.175348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:21.199067 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3bb5c-5730-4a11-a74f-9902efa28e16 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:21.239282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:21.240523 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:21.240807 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:21.241080 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:21.248871 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:21.250315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:29:21.262416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:21.263644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:21.264761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 623/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:21.269757 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405315-651d-4521-8752-265cada08182 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:21.380671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405315-651d-4521-8752-265cada08182 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:21.421680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:21.422371 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:21.422668 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:21.422945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:21.423754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:21.424071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:21.425592 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f33b4-701a-411f-9a91-d34c7a19fe4b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:21.441393 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 622/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:21.448150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:21.571914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b2d67-b146-4828-ae1c-8240005df6bb None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:21.612656 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:21.613269 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:21.613550 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:21.613823 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:21.614570 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] RBAC: Adding query filter params (role.id=e8a491bb8bb64f8a8094f089b70ae62d, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f6aae5696d46443686c84424744ec36d) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:21.614882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:21.616369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6988b9-391e-4469-8141-18ff35f2b2ba None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:21.622494 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 624/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:29:21 2022] GET /identity/v3/role_assignments?user.id=f6aae5696d46443686c84424744ec36d&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=e8a491bb8bb64f8a8094f089b70ae62d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:29:23.878716 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bdce6-e653-4488-81ce-e628e0ef816c None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:23.879415 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bdce6-e653-4488-81ce-e628e0ef816c None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:23.879415 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bdce6-e653-4488-81ce-e628e0ef816c None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:23.881524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 623/1247] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:23.888727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:23.889184 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:23.889347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:23.896734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:23.910152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:23.911529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:23.990854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 625/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:24.269517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bdce6-e653-4488-81ce-e628e0ef816c None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:24.289443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:24.379625 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bdce6-e653-4488-81ce-e628e0ef816c None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:24.415548 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:24.416189 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:24.416463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:24.416729 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:24.428141 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:29:24.433132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:24.434511 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:29:24.435584 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:24.439311 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 624/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:24.440590 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:24.554353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b8a43-f541-490b-b1e2-54ef7877f128 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:24.587796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:24.593267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:24.593876 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:24.594155 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:24.594426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:24.595082 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:24.595406 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:24.596754 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:24.606129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 626/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:24.611849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:24.691354 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:24.717171 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e067-2a10-4823-9cf1-78dcfecab566 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:24.752260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:24.752887 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:24.753166 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:24.753436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:24.763228 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:24.764673 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:24.779667 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:24.780786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:24.781846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:24.781846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:24.781846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:24.781846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 625/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:24.787539 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:24.890724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9a3ff-57c6-4453-812d-f5436903d5b2 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:24.929767 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40062216-94b5-4556-97fd-37194e505699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:24.930357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40062216-94b5-4556-97fd-37194e505699 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:24.930630 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40062216-94b5-4556-97fd-37194e505699 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:24.930898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40062216-94b5-4556-97fd-37194e505699 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:24.931549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40062216-94b5-4556-97fd-37194e505699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:24.931883 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40062216-94b5-4556-97fd-37194e505699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:24.933232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40062216-94b5-4556-97fd-37194e505699 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:24.945450 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 627/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:24.951323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:25.048661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc08423-8a83-43c8-9335-b20be777df5d None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:25.074190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:25.082051 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:25.082670 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:25.082949 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:25.083852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:25.091227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:25.092661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:29:25.103825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:25.104914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:25.106070 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 626/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:25.112760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40062216-94b5-4556-97fd-37194e505699 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:25.167745 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:25.211873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40062216-94b5-4556-97fd-37194e505699 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:25.244522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:25.245119 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:25.245394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:25.245661 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:25.246376 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:25.246674 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:25.248121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:25.265045 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 628/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 9 04:29:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:25.271599 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:25.369378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e354029-a2f6-405b-bf43-2f2eb972cafe None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:25.401660 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:25.402244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:25.402520 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:25.402790 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:25.456272 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:25.468695 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:25.470130 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:25.579283 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 627/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:29:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:29:25.585173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:25.683076 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c692dcf-03b9-45c8-86d2-dc18ea48b569 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:25.696092 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:25.716800 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:25.717357 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:25.717635 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:25.717905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:25.728580 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:25.730016 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:25.744937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:25.746040 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:25.747122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:25.747122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:25.747122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:25.747122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 629/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:25.751718 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:25.837226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:25.850303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76c7de-7414-46b5-aae0-d3cfbc10e513 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:25.883612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:25.884214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:25.884491 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:25.884760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:25.885388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:25.885687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:25.887050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:25.898032 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 628/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:25.903665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:26.002825 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a730a-075a-4925-b4e2-7737cd8a9867 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:26.034962 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:26.035597 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:26.035874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:26.036144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:26.043063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:26.044519 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:29:26.055358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:26.056391 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:26.057556 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 630/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:26.062412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:26.159193 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3979-49bc-4230-a456-06e24ecd864c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:26.195831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:26.196415 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:26.196691 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:26.196959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:26.197636 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:26.197932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:26.199372 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ecb93-f8c3-4819-a071-bc76180732b6 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:26.211851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 629/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:26.217792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:26.243991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:26.316748 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aa66e-4618-4598-99b4-5e2f4412c935 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:26.349744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:26.350334 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:26.350611 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:26.350873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:26.351613 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f6aae5696d46443686c84424744ec36d) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:26.351914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:26.353325 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97faec6-17a0-4fff-b62e-114048d5805f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:26.358510 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 631/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:29:26 2022] GET /identity/v3/role_assignments?user.id=f6aae5696d46443686c84424744ec36d&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=d4776e2384644965a0ae59d37530328f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:28.476754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb15c-f252-4531-90a9-7bc5ae46a497 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:28.477322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb15c-f252-4531-90a9-7bc5ae46a497 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:28.477322 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb15c-f252-4531-90a9-7bc5ae46a497 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:28.478614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 630/1261] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:28.483862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:28.484262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:28.484368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:28.504288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:28.506088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:28.581022 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 632/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:28.847163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feb15c-f252-4531-90a9-7bc5ae46a497 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:28.858517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:28.949792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feb15c-f252-4531-90a9-7bc5ae46a497 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:28.983212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:28.983833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:28.984111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:28.984382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:28.994781 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:29:28.999626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:29.000683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:29.001847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 631/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:29.006901 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:29.025492 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:29.103737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf2a1-1bb2-4323-bd80-c1422ec95dba None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:29.135285 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:29.135875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:29.136149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:29.136415 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:29.137064 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:29.137358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:29.138696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:29.146889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 633/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:29.152558 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:29.218523 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:29.254114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede16a8-6141-4755-a02d-f75b33676665 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:29.287906 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:29.288518 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:29.288793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:29.289057 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:29.298603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:29.300060 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:29.314402 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:29.320463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:29.321567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:29.321567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:29.321567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:29.321567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 632/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:29.321847 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:29.400152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:29.419216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16736ca-58be-4e14-9cad-795db17d26ce None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:29.452287 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:29.452870 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:29.453145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:29.453413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:29.454034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:29.454329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:29.455700 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:29.467512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 634/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:29.473200 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:29.579837 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8ec07-b1cf-4c5f-b7f2-98160420a1db None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:29.599319 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:29.613091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:29.613723 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:29.614004 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:29.614323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:29.621515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:29.622961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:29:29.634473 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:29.635658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:29.636808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 633/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:29.641423 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:29.738499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adeb27-0907-4b27-8438-867681597a1d None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:29.772842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:29.773405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:29.773677 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:29.773940 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] PATH_INFO: `/v3/users` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:29.774643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:29.774937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:29.776356 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:29.784561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:29.792985 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 635/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:29.798625 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:29.898209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b583dd2-17db-49ca-987b-631398cefc6c None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:29.931143 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:29.931766 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:29.932125 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:29.932401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:29.943626 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:29.945215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:29.959336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:29.960431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:29.961555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:29.961555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:29.961555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:29.961555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 634/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:29.966191 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:30.061991 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add1b2-d538-4f65-8be2-ceae1dc8724f None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:30.094603 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:30.095223 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:30.095503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:30.095765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:30.096392 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:30.096689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:30.098025 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:30.108974 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 636/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 04:29:30.115186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:30.146563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:30.214097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73f666-ef15-4807-b721-9f15d15dc933 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:30.248412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:30.249034 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:30.249313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:30.249586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:30.256287 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:30.257735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:29:30.268749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:30.269792 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:30.271041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 635/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:30.275743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:30.332441 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:30.373046 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b47b2-033a-43fe-98ac-f8058393ac21 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:30.404665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:30.405258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:30.405536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:30.405804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:30.406481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:30.406781 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:30.408222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80170bd9-8138-4e39-9d44-47b7929fdc1a None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:30.420267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 637/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:30.426140 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:30.521795 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:30.530791 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3cf69-0f7c-47e8-b7b5-ea77b2f7e34b None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:30.563565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a34333-46ec-4bc4-97e0-ec87f5721d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:30.564210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a34333-46ec-4bc4-97e0-ec87f5721d7b None admin] REQUEST_METHOD: `PUT` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:30.564485 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a34333-46ec-4bc4-97e0-ec87f5721d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:30.564754 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a34333-46ec-4bc4-97e0-ec87f5721d7b None admin] PATH_INFO: `/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f6aae5696d46443686c84424744ec36d/roles/d4776e2384644965a0ae59d37530328f` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:30.566597 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a34333-46ec-4bc4-97e0-ec87f5721d7b None admin] RBAC: Authorizing `identity:create_grant(project_id=49baaedc16c64edc915fbb9450b19c2f, user_id=f6aae5696d46443686c84424744ec36d, role_id=d4776e2384644965a0ae59d37530328f)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:30.568077 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a34333-46ec-4bc4-97e0-ec87f5721d7b None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:30.580191 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 636/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 9 04:29:30 2022] PUT /identity/v3/projects/49baaedc16c64edc915fbb9450b19c2f/users/f6aae5696d46443686c84424744ec36d/roles/d4776e2384644965a0ae59d37530328f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:29:32.728228 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ec5c-0897-47a9-97f1-46a30ac57265 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:32.728744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ec5c-0897-47a9-97f1-46a30ac57265 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:32.728744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ec5c-0897-47a9-97f1-46a30ac57265 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:32.730102 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 638/1274] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:32.735266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:32.735665 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:32.735808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:32.754218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:32.755678 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:32.820942 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 637/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:33.104941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ec5c-0897-47a9-97f1-46a30ac57265 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:33.203769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ec5c-0897-47a9-97f1-46a30ac57265 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:33.221538 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:33.238549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:33.239262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:33.239543 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:33.239815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:33.249678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 04:29:33.254465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:33.256226 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:33.257281 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 639/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 9 04:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:33.262243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:33.344363 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:33.363267 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65715d9-7576-4fe0-937f-2834e3de895b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:33.396818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:33.397410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:33.397689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:33.397960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:33.398612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:33.398912 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:33.400312 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:33.408049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 638/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 9 04:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:33.414127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:33.516789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02b79-d1fc-4da7-9446-de8c801fdc62 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:33.561322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:33.561971 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:33.562326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:33.562598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:33.574073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:33.575674 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:33.590531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:33.591690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:33.592803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:33.592803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:33.592803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:33.592803 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 640/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:33.597424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:33.695689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379edc89-ef2c-4a1b-bb80-b15bc52c5670 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:33.728828 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:33.729422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:33.729698 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:33.729966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:33.730593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:33.730891 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:33.732279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:33.744396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 639/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:33.750039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:33.780554 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:33.848374 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea662-6315-4c93-9f48-b9e9e1d950ba None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:33.881410 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:33.882030 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:33.882310 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:33.882582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:33.889698 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:33.891144 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 04:29:33.902221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:33.903341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:33.904293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 641/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 04:29:33.909015 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:33.913365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:34.007444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5112-a4ef-424d-9260-12187eda13fd None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:34.040218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:34.040835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:34.041113 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:34.041385 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:34.042109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:34.042414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:34.043869 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:34.061117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 640/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 9 04:29:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:34.066794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:34.154476 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:34.164416 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2e6a-c567-4355-a676-d8b5689ffa6b None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:34.197627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:34.198224 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:34.198508 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:34.198782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:34.264502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:34.265873 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:34.351367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:34.361522 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 642/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 9 04:29:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 04:29:34.367887 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:34.428220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:34.466443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ff8e-ba34-4ca5-aa80-cebab6803cdc None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:34.500736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:34.501483 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:34.501871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:34.502260 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:34.513360 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:34.514852 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 04:29:34.529202 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:34.534589 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 04:29:34.535784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 04:29:34.535784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 04:29:34.535784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:34.535784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 641/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:34.536121 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:34.633218 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048293d1-a378-46e2-8109-8cc872a288e8 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:34.666239 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:34.666834 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:34.667133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:34.667413 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] PATH_INFO: `/v3/domains` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:34.668043 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:34.668343 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:34.669692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:34.680615 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 643/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 9 04:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:34.686380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:34.783454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135afcf-5ff2-4e25-a50b-ea9fd717caad None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:34.796463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:34.816388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:34.817003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:34.817800 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:34.818071 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:34.824437 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:34.825864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 04:29:34.836829 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:34.837900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: ERROR keystone.server.flask.application Sep 09 04:29:34.839083 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 642/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 9 04:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:34.843787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:34.893312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:34.944227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403866-b1fc-4d8b-a764-699797e86817 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:34.977090 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:34.977690 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:34.977967 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:34.978236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:34.978921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:34.979252 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:34.980666 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772f0db-8d37-4f9a-9f56-115dbc5d7ea8 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:34.992850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 644/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 9 04:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:34.998864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:35.097301 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981988-0d03-41b3-8364-efb20b22e0e0 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:35.130849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:35.131887 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:35.132378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:35.132853 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:35.134172 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] RBAC: Adding query filter params (role.id=d4776e2384644965a0ae59d37530328f, scope.project.id=49baaedc16c64edc915fbb9450b19c2f, user.id=f6aae5696d46443686c84424744ec36d) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:35.134748 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:35.136687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81c8a-b17c-48bb-a08c-562eb578dced None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:35.142324 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 643/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 9 04:29:34 2022] GET /identity/v3/role_assignments?user.id=f6aae5696d46443686c84424744ec36d&scope.project.id=49baaedc16c64edc915fbb9450b19c2f&role.id=d4776e2384644965a0ae59d37530328f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:37.292620 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c8d2-266f-4d0b-b11d-2fd95d4303a4 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:37.293131 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c8d2-266f-4d0b-b11d-2fd95d4303a4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:37.293245 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c8d2-266f-4d0b-b11d-2fd95d4303a4 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:37.294484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 645/1288] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:37.299612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:37.299980 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:37.300155 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:37.318233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:37.319433 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:37.348338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:37.384849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 644/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 04:29:37.654408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c8d2-266f-4d0b-b11d-2fd95d4303a4 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:37.752657 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c8d2-266f-4d0b-b11d-2fd95d4303a4 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:37.764628 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:37.788382 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:37.788998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:37.789273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:37.789540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] PATH_INFO: `/v3/services/placement` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:37.790111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:37.791481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:37.799939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:37.801123 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:37.802433 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 646/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:29:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:37.807179 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:37.903507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3be79-5d7a-4e20-bfae-4023f6921125 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:37.936106 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:37.936633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:37.936909 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:37.937176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:37.937818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:37.938111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:37.939498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a212a9-1be6-4603-939d-51ee2722716c None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:37.944841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 645/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 9 04:29:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:37.950447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:38.047481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7296d3-c7a6-41dc-a720-399de9254ecf None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:38.080207 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:38.080793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:38.081072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:38.081345 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] PATH_INFO: `/v3/services` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:38.081965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:38.082265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:38.083727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c168201-2456-47e1-8406-12e5f575ebbb None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:38.087978 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 647/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 9 04:29:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:40.226567 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0829d2b-c56d-4fe3-986e-e47f6edd7c0d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:40.227124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0829d2b-c56d-4fe3-986e-e47f6edd7c0d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:40.227124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0829d2b-c56d-4fe3-986e-e47f6edd7c0d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:40.228463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 646/1293] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:40.233740 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42111-87d8-43d8-bb0f-54ad0d7849bc None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:40.234152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42111-87d8-43d8-bb0f-54ad0d7849bc None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:40.234729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42111-87d8-43d8-bb0f-54ad0d7849bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:40.252430 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-d4e42111-87d8-43d8-bb0f-54ad0d7849bc None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:40.253606 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-d4e42111-87d8-43d8-bb0f-54ad0d7849bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:40.281979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:40.318499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 648/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:40.587193 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0829d2b-c56d-4fe3-986e-e47f6edd7c0d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:40.618151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:40.686613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0829d2b-c56d-4fe3-986e-e47f6edd7c0d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:40.719306 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10980-e9c4-4d76-937e-86e8a343ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:40.719904 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10980-e9c4-4d76-937e-86e8a343ea69 None admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:40.720180 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10980-e9c4-4d76-937e-86e8a343ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:40.720452 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10980-e9c4-4d76-937e-86e8a343ea69 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:40.721088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10980-e9c4-4d76-937e-86e8a343ea69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:40.722443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10980-e9c4-4d76-937e-86e8a343ea69 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:40.736446 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 647/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 9 04:29:40 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:29:42.869844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768485-a3ff-4801-94ca-a3337e5c832c None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:42.870368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768485-a3ff-4801-94ca-a3337e5c832c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:42.870368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768485-a3ff-4801-94ca-a3337e5c832c None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:42.871768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 649/1296] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:42.876880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:42.877297 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:42.877433 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:42.895786 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:42.896960 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:42.969223 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 648/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:43.238154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768485-a3ff-4801-94ca-a3337e5c832c None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:43.337154 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768485-a3ff-4801-94ca-a3337e5c832c None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:43.369972 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:43.370573 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:43.370854 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:43.371152 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:43.371727 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:43.373093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:43.381992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:43.383249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:43.384227 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 650/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:29:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:43.389024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:43.407425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:43.486686 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81265b-d92f-40fd-b8d8-36bb2785002c None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:43.521946 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:43.522532 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:43.522812 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:43.523174 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:43.523811 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:43.524119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:43.525502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:43.531020 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 649/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 9 04:29:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:43.539843 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:43.580113 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:43.647073 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7684-f1c2-459b-8517-1d6b67159cbe None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:43.679487 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:43.680074 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:43.680349 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:43.680614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:43.681299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] RBAC: Adding query filter params (interface=public, service_id=754b6c1bea0b4397a50744c91c0be438, region_id=RegionOne) {{(pid=81489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:43.681601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:43.682947 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bbb2b-5bd5-480c-b4cc-665b63fbba2c None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:43.688027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 651/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 9 04:29:43 2022] GET /identity/v3/endpoints?service_id=754b6c1bea0b4397a50744c91c0be438&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:43.694327 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:43.775333 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:43.792884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea769-a3f2-4a2d-af07-88181e5d77a9 None admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:43.825839 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb620e-b299-4085-8c6a-15b45cc51bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:43.826429 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb620e-b299-4085-8c6a-15b45cc51bfb None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:43.826704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb620e-b299-4085-8c6a-15b45cc51bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:43.826969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb620e-b299-4085-8c6a-15b45cc51bfb None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:43.827595 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb620e-b299-4085-8c6a-15b45cc51bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:43.828957 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb620e-b299-4085-8c6a-15b45cc51bfb None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:43.836100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 650/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 9 04:29:43 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 04:29:45.969264 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487640e-60a7-4eba-921d-215b23e55bf7 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:45.969837 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487640e-60a7-4eba-921d-215b23e55bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:45.969837 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487640e-60a7-4eba-921d-215b23e55bf7 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:45.971162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 652/1302] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:29:45.977237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:45.977613 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:45.977775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:45.996026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:29:45.997250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:29:46.061879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 651/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:29:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 04:29:46.333350 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487640e-60a7-4eba-921d-215b23e55bf7 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:46.425895 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:46.433479 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487640e-60a7-4eba-921d-215b23e55bf7 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:46.466557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:46.467188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:46.467470 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:46.467741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:46.468313 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:46.469655 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 04:29:46.478340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 04:29:46.479472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application with Lock( Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self._enter() Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application return self.creator() Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application created_value = creator( Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: ERROR keystone.server.flask.application Sep 09 04:29:46.480326 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 653/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 9 04:29:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 04:29:46.485665 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:46.563507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:46.586569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c921-0396-4fed-afa4-162c9be6e46b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:46.619395 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:46.620001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:46.620284 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:46.620560 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] PATH_INFO: `/v3/services` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:46.621188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:29:46.621492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:46.622872 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3388-a9f9-4dda-9f1d-d5232a349418 None admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:46.627857 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 652/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 9 04:29:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:29:46.635209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:29:46.731249 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6aed6-0fe9-471a-a543-dd998baf5ac1 None admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:29:46.764001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3c8ce-9843-484e-97d1-b9b586c51de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:29:46.764527 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3c8ce-9843-484e-97d1-b9b586c51de7 None admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:29:46.764804 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3c8ce-9843-484e-97d1-b9b586c51de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:29:46.765072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3c8ce-9843-484e-97d1-b9b586c51de7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:29:46.765719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3c8ce-9843-484e-97d1-b9b586c51de7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:29:46.767068 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3c8ce-9843-484e-97d1-b9b586c51de7 None admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:29:46.786347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 654/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:29:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:29:56.625424 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=30 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:29:56.781408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:51.431858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df124b8d-ec4b-4b93-a23b-d225e594bb87 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:51.432436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df124b8d-ec4b-4b93-a23b-d225e594bb87 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:51.432436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df124b8d-ec4b-4b93-a23b-d225e594bb87 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:51.433834 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 653/1307] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:30:51.439869 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626464e1-ab3a-412d-b059-a4119743f1e4 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:51.440481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626464e1-ab3a-412d-b059-a4119743f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:51.440481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626464e1-ab3a-412d-b059-a4119743f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:51.531584 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-626464e1-ab3a-412d-b059-a4119743f1e4 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:30:51.532795 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-626464e1-ab3a-412d-b059-a4119743f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:51.657036 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 655/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 04:30:51.952856 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ee8c-11ef-4df6-acbd-6dc1e4a91771 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:51.953140 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ee8c-11ef-4df6-acbd-6dc1e4a91771 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:51.953694 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ee8c-11ef-4df6-acbd-6dc1e4a91771 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:51.955831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 654/1309] 10.222.0.18 () {54 vars in 965 bytes} [Fri Sep 9 04:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:30:51.961789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae98193-c417-4880-bebe-a80f51efb476 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:51.962185 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae98193-c417-4880-bebe-a80f51efb476 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:51.962531 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae98193-c417-4880-bebe-a80f51efb476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:52.056614 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-7ae98193-c417-4880-bebe-a80f51efb476 None None] MFA Rules not processed for user `4ee9e5824883448c9b52a0e292edf1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:30:52.057977 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-7ae98193-c417-4880-bebe-a80f51efb476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:52.083905 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:52.149010 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 656/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Fri Sep 9 04:30:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:30:52.158867 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ee8c-11ef-4df6-acbd-6dc1e4a91771 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:30:52.160687 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ac85ee8c-11ef-4df6-acbd-6dc1e4a91771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:52.285979 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ee8c-11ef-4df6-acbd-6dc1e4a91771 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:30:52.365409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:30:52.366017 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:52.366295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:52.366566 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:52.368383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:52.426475 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:52.488227 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:30:52.489598 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f15326-01ba-4e6f-942a-aca8a21d1921 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:30:52.509321 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 655/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:30:54.966213 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02490c-4d86-4c8d-b2ad-4c70b5342f0c None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:54.966734 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02490c-4d86-4c8d-b2ad-4c70b5342f0c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:54.966852 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02490c-4d86-4c8d-b2ad-4c70b5342f0c None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:54.968156 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 657/1312] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:30:54.976115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d72235-44bb-48e5-8ef0-d782d37054ab None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:54.976530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d72235-44bb-48e5-8ef0-d782d37054ab None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:54.976665 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d72235-44bb-48e5-8ef0-d782d37054ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:55.046973 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a8d72235-44bb-48e5-8ef0-d782d37054ab None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:30:55.048253 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a8d72235-44bb-48e5-8ef0-d782d37054ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:55.144232 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 656/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:30:55.433034 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02490c-4d86-4c8d-b2ad-4c70b5342f0c None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:30:55.434903 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-df02490c-4d86-4c8d-b2ad-4c70b5342f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:55.545772 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02490c-4d86-4c8d-b2ad-4c70b5342f0c None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:30:55.618949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:55.621302 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:30:55.621979 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:55.622495 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:55.622915 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:55.624775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:55.731919 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:30:55.733352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762517ca-cb49-4eb0-acb8-4442f9f6233f service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:30:55.753549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 658/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:30:58.251964 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583012a-7ee4-4f78-80af-5004a91d3147 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:58.252474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583012a-7ee4-4f78-80af-5004a91d3147 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:58.252474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583012a-7ee4-4f78-80af-5004a91d3147 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:58.253682 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 657/1315] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:30:58.259384 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dcb41-102d-419b-8276-1a9f941ff8d6 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:58.259891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dcb41-102d-419b-8276-1a9f941ff8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:58.259987 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dcb41-102d-419b-8276-1a9f941ff8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:58.324775 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-e83dcb41-102d-419b-8276-1a9f941ff8d6 None None] MFA Rules not processed for user `42675cfd2cb948e594dd6524b6c13979`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:30:58.325963 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e83dcb41-102d-419b-8276-1a9f941ff8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:58.376686 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:58.421912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 659/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:30:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:30:58.710831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583012a-7ee4-4f78-80af-5004a91d3147 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:30:58.712387 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-1583012a-7ee4-4f78-80af-5004a91d3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:58.722311 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:58.814807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583012a-7ee4-4f78-80af-5004a91d3147 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:30:58.886614 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:30:58.887243 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:30:58.887524 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:30:58.887794 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:30:58.889405 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:30:58.952069 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:30:58.998793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:30:59.000192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaa4b0-4b67-41bf-a0d6-5474ba0425e8 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:30:59.018901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 658/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:30:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:01.744369 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255191-0146-4ded-ab5b-338d912dce51 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:01.744968 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255191-0146-4ded-ab5b-338d912dce51 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:01.744968 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255191-0146-4ded-ab5b-338d912dce51 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:01.747499 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 660/1318] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:01.754733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706118f7-d359-4dc7-bf01-b655f0520974 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:01.755252 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706118f7-d359-4dc7-bf01-b655f0520974 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:01.755568 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706118f7-d359-4dc7-bf01-b655f0520974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:01.832242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-706118f7-d359-4dc7-bf01-b655f0520974 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:01.834316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-706118f7-d359-4dc7-bf01-b655f0520974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:01.948230 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 659/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:02.264162 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41255191-0146-4ded-ab5b-338d912dce51 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:02.265699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-41255191-0146-4ded-ab5b-338d912dce51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:02.369021 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41255191-0146-4ded-ab5b-338d912dce51 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:02.443188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:02.443792 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:02.444071 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:02.444340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:02.445947 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:02.452768 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:02.559485 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:02.560831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e930b-79a1-47ba-ab71-a3bad57e6efe service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:02.578496 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 661/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:05.338612 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f82a0-15d3-4d2f-877e-a754bed77f81 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:05.339176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f82a0-15d3-4d2f-877e-a754bed77f81 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:05.339176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f82a0-15d3-4d2f-877e-a754bed77f81 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:05.340517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 660/1321] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:05.346515 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc32bc-35f0-4ab9-91ae-f5e3df23aadb None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:05.346938 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc32bc-35f0-4ab9-91ae-f5e3df23aadb None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:05.347192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc32bc-35f0-4ab9-91ae-f5e3df23aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:05.418687 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-accc32bc-35f0-4ab9-91ae-f5e3df23aadb None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:05.419982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-accc32bc-35f0-4ab9-91ae-f5e3df23aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:05.497675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:05.551516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 662/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:05.848508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c07a8-cf34-4d01-9f70-517184139b60 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:05.848897 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c07a8-cf34-4d01-9f70-517184139b60 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:05.849237 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c07a8-cf34-4d01-9f70-517184139b60 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:05.850636 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 661/1323] 10.222.0.18 () {54 vars in 965 bytes} [Fri Sep 9 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:05.856765 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaea1b-34f9-4815-b19f-ed40b199620f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:05.857048 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaea1b-34f9-4815-b19f-ed40b199620f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:05.857316 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaea1b-34f9-4815-b19f-ed40b199620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:05.934157 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-2ecaea1b-34f9-4815-b19f-ed40b199620f None None] MFA Rules not processed for user `4ee9e5824883448c9b52a0e292edf1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:05.935375 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2ecaea1b-34f9-4815-b19f-ed40b199620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:06.010816 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 663/1324] 10.222.0.18 () {58 vars in 1062 bytes} [Fri Sep 9 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:06.020742 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c07a8-cf34-4d01-9f70-517184139b60 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:06.022290 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-de8c07a8-cf34-4d01-9f70-517184139b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:06.042337 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:06.126448 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c07a8-cf34-4d01-9f70-517184139b60 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:06.199950 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:06.200553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:06.200832 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:06.201105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:06.202696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:06.279304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:06.317743 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:06.319219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfebb9a-f9fe-4177-953b-a974fa9bd1a8 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:06.337851 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 662/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:08.805742 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21bf5-f43d-4131-bfd4-b1218de5e369 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:08.806215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21bf5-f43d-4131-bfd4-b1218de5e369 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:08.806308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21bf5-f43d-4131-bfd4-b1218de5e369 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:08.807671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 664/1326] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:08.813186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d055902-5462-4e83-a1fa-3c828f6c7a82 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:08.814105 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d055902-5462-4e83-a1fa-3c828f6c7a82 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:08.814479 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d055902-5462-4e83-a1fa-3c828f6c7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:08.881563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-2d055902-5462-4e83-a1fa-3c828f6c7a82 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:08.882784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-2d055902-5462-4e83-a1fa-3c828f6c7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:08.980026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 663/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:09.262205 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21bf5-f43d-4131-bfd4-b1218de5e369 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:09.263867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b4c21bf5-f43d-4131-bfd4-b1218de5e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:09.325405 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:09.370135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21bf5-f43d-4131-bfd4-b1218de5e369 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:09.446136 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:09.446741 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:09.447020 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:09.447318 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:09.448916 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:09.555869 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:09.558235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:09.560524 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865e027-9ebb-4823-80b9-ab18951cc7a6 service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:09.580426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 665/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:11.839720 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5f77-f448-459e-ba65-4985c9dc0cf0 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:11.840244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5f77-f448-459e-ba65-4985c9dc0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:11.840244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5f77-f448-459e-ba65-4985c9dc0cf0 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:11.841633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 664/1329] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:11.847798 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5536-0c04-4d37-8e9e-28d54a3a4bc8 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:11.848267 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5536-0c04-4d37-8e9e-28d54a3a4bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:11.848358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5536-0c04-4d37-8e9e-28d54a3a4bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:11.916941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-501d5536-0c04-4d37-8e9e-28d54a3a4bc8 None None] MFA Rules not processed for user `42675cfd2cb948e594dd6524b6c13979`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:11.918146 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-501d5536-0c04-4d37-8e9e-28d54a3a4bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:12.014826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 666/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:12.299563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5f77-f448-459e-ba65-4985c9dc0cf0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:12.301102 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-506c5f77-f448-459e-ba65-4985c9dc0cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:12.332686 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:12.412358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5f77-f448-459e-ba65-4985c9dc0cf0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:12.490987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:12.491557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:12.491839 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:12.492115 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:12.493765 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:12.582351 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:12.618628 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:12.620138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ee0f8-4b50-494d-8e1e-7bd4c4a0fbfe service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:12.647308 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 665/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:15.028166 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37933ad-b30b-420a-b80b-6ae454823aab None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:15.028736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37933ad-b30b-420a-b80b-6ae454823aab None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:15.028736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37933ad-b30b-420a-b80b-6ae454823aab None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:15.030049 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 667/1332] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:15.037341 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec0bdb-9ea9-40b1-85d1-eda8e1b41988 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:15.037733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec0bdb-9ea9-40b1-85d1-eda8e1b41988 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:15.037888 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec0bdb-9ea9-40b1-85d1-eda8e1b41988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:15.102821 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-cbec0bdb-9ea9-40b1-85d1-eda8e1b41988 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:15.103873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-cbec0bdb-9ea9-40b1-85d1-eda8e1b41988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:15.201732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 666/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:15.487731 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37933ad-b30b-420a-b80b-6ae454823aab None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:15.489265 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-d37933ad-b30b-420a-b80b-6ae454823aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:15.559303 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:15.593307 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37933ad-b30b-420a-b80b-6ae454823aab None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:15.666341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:15.666946 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:15.667254 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:15.667528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:15.669122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:15.777132 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:15.778483 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df6e29-5331-47d4-abb0-deae4657a44e service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:15.788872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:15.797201 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 668/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:17.996965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e490-6ee2-4cfe-ae6e-c59512db599f None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:17.997419 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e490-6ee2-4cfe-ae6e-c59512db599f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:17.997516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e490-6ee2-4cfe-ae6e-c59512db599f None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:17.998878 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 667/1335] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:18.005460 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa749-4a75-40ef-959c-926b23253382 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:18.005881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa749-4a75-40ef-959c-926b23253382 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:18.005992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa749-4a75-40ef-959c-926b23253382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:18.072258 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-456fa749-4a75-40ef-959c-926b23253382 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:18.073472 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-456fa749-4a75-40ef-959c-926b23253382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:18.169235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 669/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:18.453024 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e490-6ee2-4cfe-ae6e-c59512db599f None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:18.455411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-5cd9e490-6ee2-4cfe-ae6e-c59512db599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:18.494870 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:18.559918 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e490-6ee2-4cfe-ae6e-c59512db599f None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:18.632171 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:18.632766 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:18.633039 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:18.633303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:18.634882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:18.717989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:18.743789 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:18.745220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b892b-5bdf-48b2-8751-c2869243fb27 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:18.763726 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 668/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:21.231980 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08323008-0a92-4440-8af4-66b00d1cc4f4 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:21.232565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08323008-0a92-4440-8af4-66b00d1cc4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:21.232565 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08323008-0a92-4440-8af4-66b00d1cc4f4 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:21.233863 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 670/1338] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:21.239269 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8e74-987d-4c96-b06d-9893176f8b41 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:21.239719 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8e74-987d-4c96-b06d-9893176f8b41 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:21.239825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8e74-987d-4c96-b06d-9893176f8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:21.304864 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-703c8e74-987d-4c96-b06d-9893176f8b41 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:21.306072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-703c8e74-987d-4c96-b06d-9893176f8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:21.404490 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 669/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:21.692892 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08323008-0a92-4440-8af4-66b00d1cc4f4 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:21.694437 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-08323008-0a92-4440-8af4-66b00d1cc4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:21.769468 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:21.796273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08323008-0a92-4440-8af4-66b00d1cc4f4 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:21.869323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:21.869927 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:21.870206 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:21.870477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:21.872089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:21.980590 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:21.982039 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f5ec2-d52c-419c-a09f-4fe853a29a86 service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:22.000842 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 671/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:26.076305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54c404-6454-443c-bc3b-16dba9c47a12 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:26.076859 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54c404-6454-443c-bc3b-16dba9c47a12 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:26.076956 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54c404-6454-443c-bc3b-16dba9c47a12 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:26.078218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 670/1341] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:26.083782 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bca3b-ed5e-4ae3-a9f9-7d1eebb7a881 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:26.084186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bca3b-ed5e-4ae3-a9f9-7d1eebb7a881 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:26.084462 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bca3b-ed5e-4ae3-a9f9-7d1eebb7a881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:26.089995 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:26.151404 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3f1bca3b-ed5e-4ae3-a9f9-7d1eebb7a881 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:26.152482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3f1bca3b-ed5e-4ae3-a9f9-7d1eebb7a881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:26.253261 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 672/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:26.539671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54c404-6454-443c-bc3b-16dba9c47a12 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:26.541214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0d54c404-6454-443c-bc3b-16dba9c47a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:26.590357 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:26.649929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54c404-6454-443c-bc3b-16dba9c47a12 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:26.725680 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:26.726286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:26.726556 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:26.726818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:26.728418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:26.821987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:26.838444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:26.840076 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c884af9-1111-488a-93f3-f2033edf6170 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:26.858973 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 671/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:29.684361 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b71e68-893d-4666-9163-2fd8b342107d None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:29.684886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b71e68-893d-4666-9163-2fd8b342107d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:29.684886 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b71e68-893d-4666-9163-2fd8b342107d None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:29.686253 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 673/1344] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:29.691728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fb793-43c3-48a5-b979-2215df6a10cd None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:29.692111 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fb793-43c3-48a5-b979-2215df6a10cd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:29.692299 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fb793-43c3-48a5-b979-2215df6a10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:29.758787 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-003fb793-43c3-48a5-b979-2215df6a10cd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:29.760049 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-003fb793-43c3-48a5-b979-2215df6a10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:29.857271 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 672/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:30.143956 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b71e68-893d-4666-9163-2fd8b342107d None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:30.145481 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-f1b71e68-893d-4666-9163-2fd8b342107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:30.238306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:30.258288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b71e68-893d-4666-9163-2fd8b342107d None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:30.336518 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:30.337122 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:30.337400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:30.337670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:30.339290 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:30.457704 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:30.459198 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3a7dc-d214-440b-ada2-38ad9242f5ad service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:30.478206 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 674/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:34.618446 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a663c5-ecb8-4f0f-ac03-5e06ac0ed85d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:34.618959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a663c5-ecb8-4f0f-ac03-5e06ac0ed85d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:34.619051 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a663c5-ecb8-4f0f-ac03-5e06ac0ed85d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:34.620664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 673/1347] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:34.628312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee824546-e309-4852-a544-ad28bca4e3fd None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:34.628721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee824546-e309-4852-a544-ad28bca4e3fd None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:34.628865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee824546-e309-4852-a544-ad28bca4e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:34.644995 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:34.700143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-ee824546-e309-4852-a544-ad28bca4e3fd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:34.701346 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-ee824546-e309-4852-a544-ad28bca4e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:34.802289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 675/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:35.088013 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a663c5-ecb8-4f0f-ac03-5e06ac0ed85d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:35.089534 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d3a663c5-ecb8-4f0f-ac03-5e06ac0ed85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:35.147443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:35.193089 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a663c5-ecb8-4f0f-ac03-5e06ac0ed85d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:35.269278 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:35.269889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:35.270168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:35.270442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:35.272092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:35.378478 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:35.382775 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:35.384258 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f77971-b503-4476-abb5-00dd8265955f service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:35.402578 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 674/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:40.303199 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901dd3-c142-41cd-af47-db6b7768f9b4 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:40.303634 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901dd3-c142-41cd-af47-db6b7768f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:40.303744 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901dd3-c142-41cd-af47-db6b7768f9b4 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:40.305381 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 676/1350] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 9 04:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:40.311516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cff54-b2eb-431b-8632-b154d378ce73 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:40.314316 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cff54-b2eb-431b-8632-b154d378ce73 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:40.315085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cff54-b2eb-431b-8632-b154d378ce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:40.416039 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-0c2cff54-b2eb-431b-8632-b154d378ce73 None None] MFA Rules not processed for user `f6aae5696d46443686c84424744ec36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:40.417835 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0c2cff54-b2eb-431b-8632-b154d378ce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:40.597147 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 675/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 9 04:31:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:44.727536 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177cdd-86d4-49d8-a61d-2868a55c4420 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:44.728065 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177cdd-86d4-49d8-a61d-2868a55c4420 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:44.728383 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177cdd-86d4-49d8-a61d-2868a55c4420 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:44.729941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 677/1352] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 9 04:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:44.735213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a557f-8e60-4a9c-8ed0-4d4e91cda72b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:44.735661 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a557f-8e60-4a9c-8ed0-4d4e91cda72b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:44.735764 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a557f-8e60-4a9c-8ed0-4d4e91cda72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:44.794651 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:44.801420 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=59 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:44.821759 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ac2a557f-8e60-4a9c-8ed0-4d4e91cda72b None None] MFA Rules not processed for user `f6aae5696d46443686c84424744ec36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:44.823169 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ac2a557f-8e60-4a9c-8ed0-4d4e91cda72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:44.941442 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 676/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 9 04:31:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:46.456589 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1291bd-8c82-4d3a-bfa1-577c810f3404 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:46.457109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1291bd-8c82-4d3a-bfa1-577c810f3404 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:46.457109 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1291bd-8c82-4d3a-bfa1-577c810f3404 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:46.458463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 678/1354] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 9 04:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:46.463607 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba2bd-5b41-4575-87fd-4baba79766b8 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:46.464029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba2bd-5b41-4575-87fd-4baba79766b8 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:46.464302 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba2bd-5b41-4575-87fd-4baba79766b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:46.544470 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-e56ba2bd-5b41-4575-87fd-4baba79766b8 None None] MFA Rules not processed for user `f6aae5696d46443686c84424744ec36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:46.545592 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-e56ba2bd-5b41-4575-87fd-4baba79766b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:46.589422 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:46.654749 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 677/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 9 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:50.253417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31bec-8c83-44f1-af6c-8c7f73d31c26 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:50.254270 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31bec-8c83-44f1-af6c-8c7f73d31c26 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:50.254718 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31bec-8c83-44f1-af6c-8c7f73d31c26 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:50.260388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 679/1356] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:50.262841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05890281-c2d8-4760-97e3-88d87d381a2d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:50.263323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05890281-c2d8-4760-97e3-88d87d381a2d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:50.263535 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05890281-c2d8-4760-97e3-88d87d381a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:50.347760 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-05890281-c2d8-4760-97e3-88d87d381a2d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:50.349128 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-05890281-c2d8-4760-97e3-88d87d381a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:50.463358 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 678/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:50.766282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e5d8-248f-4630-9318-b1ca224ad73b None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:50.766564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e5d8-248f-4630-9318-b1ca224ad73b None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:50.767010 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e5d8-248f-4630-9318-b1ca224ad73b None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:50.768354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 680/1358] 10.222.0.18 () {54 vars in 962 bytes} [Fri Sep 9 04:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:50.777507 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc72b-e965-47a0-9942-5ee367184be0 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:50.777801 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc72b-e965-47a0-9942-5ee367184be0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:50.778114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc72b-e965-47a0-9942-5ee367184be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:50.807046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:50.882516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-0dbfc72b-e965-47a0-9942-5ee367184be0 None None] MFA Rules not processed for user `d2fb8c8ee6324e4ba6c328a9c2450fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:50.883659 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0dbfc72b-e965-47a0-9942-5ee367184be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:51.014481 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 679/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Sep 9 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:51.022802 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e5d8-248f-4630-9318-b1ca224ad73b None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:51.024682 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-8320e5d8-248f-4630-9318-b1ca224ad73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:51.178282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e5d8-248f-4630-9318-b1ca224ad73b None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:51.261855 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:51.321204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:51.322272 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:51.322552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:51.322824 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:51.324596 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:51.434373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:51.436088 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf4a32-ea30-4cba-9ad3-16bed8fcaea9 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:51.457215 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 681/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:31:53.870704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b679a4-61b9-42ea-b99d-5548f84c2a68 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:53.870704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b679a4-61b9-42ea-b99d-5548f84c2a68 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:53.870704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b679a4-61b9-42ea-b99d-5548f84c2a68 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:53.870704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 680/1361] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:53.875939 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7692-8750-4558-a7c2-a43c11e53181 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:53.876610 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7692-8750-4558-a7c2-a43c11e53181 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:53.876610 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7692-8750-4558-a7c2-a43c11e53181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:53.948024 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-ceec7692-8750-4558-a7c2-a43c11e53181 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:53.949212 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-ceec7692-8750-4558-a7c2-a43c11e53181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:53.992101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:54.055234 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 682/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:54.349930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b679a4-61b9-42ea-b99d-5548f84c2a68 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:54.352925 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-12b679a4-61b9-42ea-b99d-5548f84c2a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:54.439471 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:54.555662 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b679a4-61b9-42ea-b99d-5548f84c2a68 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:54.689320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:54.689935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:54.690212 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:54.690485 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:54.692117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:54.714777 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:54.785305 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:54.786901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f08b70-35e5-4067-b685-29adfac12f82 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:54.805988 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 681/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:31:57.314696 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cccb6-ad6b-4bb9-98ac-49b7be2b322d None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:57.315336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cccb6-ad6b-4bb9-98ac-49b7be2b322d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:57.315336 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cccb6-ad6b-4bb9-98ac-49b7be2b322d None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:57.316622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 683/1364] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:57.322067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdac2-b2ac-4491-a85a-173d35271b96 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:57.322493 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdac2-b2ac-4491-a85a-173d35271b96 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:57.322610 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdac2-b2ac-4491-a85a-173d35271b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:57.391145 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-f86bdac2-b2ac-4491-a85a-173d35271b96 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:57.392378 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-f86bdac2-b2ac-4491-a85a-173d35271b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:57.492858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:57.501103 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 682/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 04:31:57.785417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28635-3a64-4265-909f-4fb356e77bfd None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:57.785984 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28635-3a64-4265-909f-4fb356e77bfd None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:57.786322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28635-3a64-4265-909f-4fb356e77bfd None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:57.787870 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 684/1366] 10.222.0.18 () {54 vars in 962 bytes} [Fri Sep 9 04:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:57.793451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe69d-891f-4c98-9b01-749e08115af1 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:57.793799 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe69d-891f-4c98-9b01-749e08115af1 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:57.794234 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fe69d-891f-4c98-9b01-749e08115af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:57.882553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-730fe69d-891f-4c98-9b01-749e08115af1 None None] MFA Rules not processed for user `d2fb8c8ee6324e4ba6c328a9c2450fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:57.883901 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-730fe69d-891f-4c98-9b01-749e08115af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:58.010345 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 683/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Sep 9 04:31:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:58.018633 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28635-3a64-4265-909f-4fb356e77bfd None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:58.020327 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-0cc28635-3a64-4265-909f-4fb356e77bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:58.177101 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28635-3a64-4265-909f-4fb356e77bfd None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:58.198443 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:58.304637 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:58.305247 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:58.305525 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:58.305789 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:58.307425 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:58.404385 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:58.406159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6ed0f-a267-44bd-959e-e145e56bac8a service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:58.425606 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 685/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:31:58.592412 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a749-6cb2-48ff-8876-99074645ac01 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:58.593068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a749-6cb2-48ff-8876-99074645ac01 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:58.593068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a749-6cb2-48ff-8876-99074645ac01 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:58.596643 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 684/1369] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:58.600400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70ce0f-a707-452f-80dd-30a098e88b7c None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:58.600810 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70ce0f-a707-452f-80dd-30a098e88b7c None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:58.601176 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70ce0f-a707-452f-80dd-30a098e88b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:58.638719 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:58.683652 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-bf70ce0f-a707-452f-80dd-30a098e88b7c None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:58.685408 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bf70ce0f-a707-452f-80dd-30a098e88b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:58.795275 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 686/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:59.130125 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5cf85-9eee-4b91-b71c-81bed5e5da8b None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:59.130315 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5cf85-9eee-4b91-b71c-81bed5e5da8b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:59.130622 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5cf85-9eee-4b91-b71c-81bed5e5da8b None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:59.132185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 685/1371] 10.222.0.18 () {54 vars in 964 bytes} [Fri Sep 9 04:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:31:59.136956 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f94c3-d70b-463b-b088-881078548c11 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:59.137323 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f94c3-d70b-463b-b088-881078548c11 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:59.137669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f94c3-d70b-463b-b088-881078548c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:59.219917 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-818f94c3-d70b-463b-b088-881078548c11 None None] MFA Rules not processed for user `9f896dfbd2ad452e9def2c11cfa97e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:31:59.221370 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-818f94c3-d70b-463b-b088-881078548c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:59.277354 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:59.310793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 687/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Fri Sep 9 04:31:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:31:59.318672 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5cf85-9eee-4b91-b71c-81bed5e5da8b None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:31:59.320238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-30b5cf85-9eee-4b91-b71c-81bed5e5da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:59.372055 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:59.432066 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5cf85-9eee-4b91-b71c-81bed5e5da8b None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:31:59.522289 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f896dfbd2ad452e9def2c11cfa97e53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:31:59.523274 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:31:59.523728 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:31:59.524170 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:31:59.526403 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:31:59.670030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:59.689368 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:31:59.691519 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8dd3c-2df3-4819-a357-e6de806c5384 service cinder] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:31:59.720848 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 686/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:00.701322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a83a8-faaf-4619-bc0a-90c9f8fb6013 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:00.701857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a83a8-faaf-4619-bc0a-90c9f8fb6013 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:00.702560 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a83a8-faaf-4619-bc0a-90c9f8fb6013 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:00.704012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 688/1374] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:00.709224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b66fc-ab64-45d5-ac3f-8898bb7c8286 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:00.709633 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b66fc-ab64-45d5-ac3f-8898bb7c8286 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:00.709807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b66fc-ab64-45d5-ac3f-8898bb7c8286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:00.775751 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ba8b66fc-ab64-45d5-ac3f-8898bb7c8286 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:00.777078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ba8b66fc-ab64-45d5-ac3f-8898bb7c8286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:00.873219 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 687/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:01.161393 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a83a8-faaf-4619-bc0a-90c9f8fb6013 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:01.162989 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-a51a83a8-faaf-4619-bc0a-90c9f8fb6013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:01.334431 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a83a8-faaf-4619-bc0a-90c9f8fb6013 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:01.397503 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:01.465668 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:01.466274 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:01.466549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:01.466818 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:01.469134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:01.566484 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:01.568124 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb46ed-c2c4-4aa0-b537-c137ea676106 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:01.586988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 689/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:04.110420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab1d3-9e01-44d6-b9b7-76c1dc63566d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:04.110965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab1d3-9e01-44d6-b9b7-76c1dc63566d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:04.111302 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab1d3-9e01-44d6-b9b7-76c1dc63566d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:04.112735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 688/1377] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:04.118619 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f31d2-575b-472b-afe8-1ecca43510aa None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:04.119320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f31d2-575b-472b-afe8-1ecca43510aa None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:04.119320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f31d2-575b-472b-afe8-1ecca43510aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:04.197557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3e6f31d2-575b-472b-afe8-1ecca43510aa None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:04.199440 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3e6f31d2-575b-472b-afe8-1ecca43510aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:04.207321 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:04.315000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 690/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:04.609657 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab1d3-9e01-44d6-b9b7-76c1dc63566d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:04.611281 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ef1ab1d3-9e01-44d6-b9b7-76c1dc63566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:04.674114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:04.766658 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab1d3-9e01-44d6-b9b7-76c1dc63566d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:04.898509 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:04.899028 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:04.899336 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:04.899623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:04.901214 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:04.923295 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:05.007990 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:05.009596 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce3e07-2d86-444b-8838-8402279623c4 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:05.029266 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 689/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:07.329188 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d642746-d0cd-49e8-8475-6360a7d8a110 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:07.330262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d642746-d0cd-49e8-8475-6360a7d8a110 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:07.330262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d642746-d0cd-49e8-8475-6360a7d8a110 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:07.331447 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 691/1380] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:07.337555 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8e8c-7273-4a29-b38d-8db19f91e27f None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:07.337941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8e8c-7273-4a29-b38d-8db19f91e27f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:07.338461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8e8c-7273-4a29-b38d-8db19f91e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:07.447162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-3f9d8e8c-7273-4a29-b38d-8db19f91e27f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:07.448385 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3f9d8e8c-7273-4a29-b38d-8db19f91e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:07.547931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:07.554557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 690/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:07.862736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d642746-d0cd-49e8-8475-6360a7d8a110 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:07.864330 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-1d642746-d0cd-49e8-8475-6360a7d8a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:08.024797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:08.035737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d642746-d0cd-49e8-8475-6360a7d8a110 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:08.209243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:08.209862 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:08.210143 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:08.210417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:08.212322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:08.314702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:08.316489 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfe2ba-651d-4b0e-bcc0-b6bf47634057 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:08.327633 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:08.336988 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 692/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:10.652380 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452ef4-04ce-4407-9bd9-52d55f670a13 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:10.652908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452ef4-04ce-4407-9bd9-52d55f670a13 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:10.652908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452ef4-04ce-4407-9bd9-52d55f670a13 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:10.654278 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 691/1383] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:10.660365 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077359cb-7506-41bc-a270-371a8d152077 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:10.660826 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077359cb-7506-41bc-a270-371a8d152077 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:10.660922 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077359cb-7506-41bc-a270-371a8d152077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:10.739467 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-077359cb-7506-41bc-a270-371a8d152077 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:10.740678 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-077359cb-7506-41bc-a270-371a8d152077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:10.856300 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 693/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:11.152320 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa452ef4-04ce-4407-9bd9-52d55f670a13 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:11.153847 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-fa452ef4-04ce-4407-9bd9-52d55f670a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:11.336544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa452ef4-04ce-4407-9bd9-52d55f670a13 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:11.415220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:11.485560 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:11.486184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:11.486495 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:11.486818 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:11.488563 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:11.615311 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:11.617140 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4629e8-49d8-48ff-9374-c365c45d1996 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:11.638114 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 692/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:14.090289 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e673f28-9722-4414-a742-54704ed879c9 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:14.090801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e673f28-9722-4414-a742-54704ed879c9 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:14.090801 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e673f28-9722-4414-a742-54704ed879c9 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:14.092243 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 694/1386] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:14.097807 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27c7f4-a30e-4a63-b4d5-02fff144e159 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:14.098242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27c7f4-a30e-4a63-b4d5-02fff144e159 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:14.098364 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27c7f4-a30e-4a63-b4d5-02fff144e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:14.171576 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-5f27c7f4-a30e-4a63-b4d5-02fff144e159 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:14.173031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-5f27c7f4-a30e-4a63-b4d5-02fff144e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:14.211277 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:14.287136 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 693/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:14.581315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e673f28-9722-4414-a742-54704ed879c9 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:14.582817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5e673f28-9722-4414-a742-54704ed879c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:14.674631 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:14.752342 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e673f28-9722-4414-a742-54704ed879c9 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:14.877158 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:14.877773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:14.878050 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:14.878315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:14.879949 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:14.924858 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:14.982094 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:14.984340 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15bc41-4c0f-4378-93f3-f21b447b56e9 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:15.005219 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 695/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:15.211825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5a00-f524-467a-9a4c-16373bdcd9bc None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:15.212369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5a00-f524-467a-9a4c-16373bdcd9bc None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:15.212369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5a00-f524-467a-9a4c-16373bdcd9bc None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:15.213970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 694/1389] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:15.220262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e761a-6379-41ed-bcc3-0ec214b8006d None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:15.220771 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e761a-6379-41ed-bcc3-0ec214b8006d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:15.220880 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e761a-6379-41ed-bcc3-0ec214b8006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:15.303412 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-104e761a-6379-41ed-bcc3-0ec214b8006d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:15.304721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-104e761a-6379-41ed-bcc3-0ec214b8006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:15.423517 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 696/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:15.715689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5619c-b737-46cb-8fb3-c56a2723d8f4 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:15.715974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5619c-b737-46cb-8fb3-c56a2723d8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:15.716247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5619c-b737-46cb-8fb3-c56a2723d8f4 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:15.717683 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 695/1391] 10.222.0.18 () {54 vars in 966 bytes} [Fri Sep 9 04:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:15.723442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141749e-4d40-4324-9749-047af0a10429 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:15.723729 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141749e-4d40-4324-9749-047af0a10429 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:15.723992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141749e-4d40-4324-9749-047af0a10429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:15.742881 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:15.820651 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-7141749e-4d40-4324-9749-047af0a10429 None None] MFA Rules not processed for user `71f71f58204a4569bf6d937b6691c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:15.822236 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-7141749e-4d40-4324-9749-047af0a10429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:15.903773 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 697/1392] 10.222.0.18 () {58 vars in 1063 bytes} [Fri Sep 9 04:32:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:15.917461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5619c-b737-46cb-8fb3-c56a2723d8f4 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:15.917461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0ac5619c-b737-46cb-8fb3-c56a2723d8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:16.043067 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5619c-b737-46cb-8fb3-c56a2723d8f4 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:16.124569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:16.141037 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f71f58204a4569bf6d937b6691c2f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:16.141832 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:16.141966 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:16.142231 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:16.143970 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:16.268056 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:16.269443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700e82-58b0-477e-8fa3-85fbb34d8fc6 service glance] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:16.290587 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 696/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:17.093502 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a17f-9371-4ec5-9e95-cb56f4b16ccf None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:17.094038 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a17f-9371-4ec5-9e95-cb56f4b16ccf None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:17.094149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a17f-9371-4ec5-9e95-cb56f4b16ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:17.183149 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-eda8a17f-9371-4ec5-9e95-cb56f4b16ccf None None] MFA Rules not processed for user `f83b90b6521741e4952c771c2456c8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:17.184713 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-eda8a17f-9371-4ec5-9e95-cb56f4b16ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:17.250299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:17.286331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 698/1394] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 9 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:17.293629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd69d-4b38-4d38-ad45-6eef2ad38250 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:17.294156 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd69d-4b38-4d38-ad45-6eef2ad38250 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:17.294156 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd69d-4b38-4d38-ad45-6eef2ad38250 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:17.296890 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 697/1395] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:17.302244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:17.302537 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:17.302813 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:17.344220 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ca64-bc3a-4812-b805-e0ac04b7a866 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:17.344631 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ca64-bc3a-4812-b805-e0ac04b7a866 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:17.344986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ca64-bc3a-4812-b805-e0ac04b7a866 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:17.346650 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 698/1396] 10.222.0.18 () {54 vars in 943 bytes} [Fri Sep 9 04:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:17.354215 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:17.354736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:17.355233 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:17.382884 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:17.384186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:17.448152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] MFA Rules not processed for user `240b2bed570e4968a81057b1c9495353`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:17.449480 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:17.489935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:17.506151 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 699/1397] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:17.578415 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 699/1398] 10.222.0.18 () {58 vars in 1040 bytes} [Fri Sep 9 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 04:32:17.587809 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:17.589129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:17.649141 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:17.709299 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5bc50-8012-45e9-8ee2-b1243f672bc1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:17.801401 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:17.802937 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:17.821529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240b2bed570e4968a81057b1c9495353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:17.822232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:17.822602 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:17.825670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:17.825670 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:17.903769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:17.923494 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5edff1-ce5d-4e70-825c-9c25d6a07a43 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:17.925114 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:17.927147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b860a-2906-4762-a1ab-e2a87ff8ad63 service swift] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:17.937735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 700/1399] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 9 04:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 04:32:17.997213 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:18.075804 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:18.076176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:18.077163 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:18.077590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:18.080021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:18.208553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:18.210498 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75db69-2257-4e34-b1ad-84a85765bc0d service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:18.245268 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 700/1400] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:32:20.532235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26559-dc7e-4014-a84a-fc9b2766b6b1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:20.532235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26559-dc7e-4014-a84a-fc9b2766b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:20.532235 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26559-dc7e-4014-a84a-fc9b2766b6b1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:20.533607 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 701/1401] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:32:20.539502 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed83df-5106-4bd2-864b-2f6ce23426e2 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:20.539945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed83df-5106-4bd2-864b-2f6ce23426e2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:20.540109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed83df-5106-4bd2-864b-2f6ce23426e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:20.618545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d6ed83df-5106-4bd2-864b-2f6ce23426e2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:20.619875 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d6ed83df-5106-4bd2-864b-2f6ce23426e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:20.630109 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:20.739200 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 701/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:21.031797 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26559-dc7e-4014-a84a-fc9b2766b6b1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:21.033456 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e1f26559-dc7e-4014-a84a-fc9b2766b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:21.203711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26559-dc7e-4014-a84a-fc9b2766b6b1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:21.277702 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:21.337965 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:21.338643 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:21.338921 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:21.339221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:21.340864 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:21.468331 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:21.469999 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e9f5b-533e-4815-87ee-ef37f7e86e31 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:21.495276 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 702/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:23.757384 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecdbe3-28ed-46f6-98d7-ec68c9183fd8 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:23.757951 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecdbe3-28ed-46f6-98d7-ec68c9183fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:23.757951 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecdbe3-28ed-46f6-98d7-ec68c9183fd8 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:23.759450 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 702/1404] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:23.765358 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475690c2-ddc0-4984-aa6a-8d1e9c12c7fe None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:23.765831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475690c2-ddc0-4984-aa6a-8d1e9c12c7fe None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:23.765950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475690c2-ddc0-4984-aa6a-8d1e9c12c7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:23.838373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-475690c2-ddc0-4984-aa6a-8d1e9c12c7fe None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:23.839640 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-475690c2-ddc0-4984-aa6a-8d1e9c12c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:23.860627 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:23.950711 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 703/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:24.254041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecdbe3-28ed-46f6-98d7-ec68c9183fd8 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:24.255965 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-94ecdbe3-28ed-46f6-98d7-ec68c9183fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:24.420290 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:24.427162 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecdbe3-28ed-46f6-98d7-ec68c9183fd8 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:24.566335 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:24.566889 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:24.567204 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:24.567474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:24.569123 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:24.673957 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:24.676009 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a5fa-159b-49f1-9370-6387ced46686 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:24.694044 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:24.703451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 703/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:32:26.938824 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9252c-0e2f-444e-a65a-44c90df72785 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:26.939371 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9252c-0e2f-444e-a65a-44c90df72785 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:26.939454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9252c-0e2f-444e-a65a-44c90df72785 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:26.940777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 704/1407] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:26.946030 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af583-db13-44f2-9040-6b38ef2c06c4 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:26.946451 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af583-db13-44f2-9040-6b38ef2c06c4 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:26.946736 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161af583-db13-44f2-9040-6b38ef2c06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:27.017454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-161af583-db13-44f2-9040-6b38ef2c06c4 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:27.018780 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-161af583-db13-44f2-9040-6b38ef2c06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:27.133149 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 704/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:27.439735 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9252c-0e2f-444e-a65a-44c90df72785 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:27.441259 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-31d9252c-0e2f-444e-a65a-44c90df72785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:27.601400 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9252c-0e2f-444e-a65a-44c90df72785 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:27.604166 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:27.727993 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:27.728598 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:27.728875 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:27.729145 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:27.730785 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:27.832263 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:27.834187 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e9bcd-1fdb-4cf7-88d1-0673443681f8 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:27.853209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 705/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:37.131173 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=66 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:37.850784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=97 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:41.774068 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7f0f-0a20-46dd-a046-5230de90fa86 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:41.774646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7f0f-0a20-46dd-a046-5230de90fa86 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:41.774646 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7f0f-0a20-46dd-a046-5230de90fa86 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:41.776001 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 705/1410] 10.222.0.18 () {54 vars in 918 bytes} [Fri Sep 9 04:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:41.781706 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4bc4-e38e-455a-8031-6cb791c645b8 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:41.782110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4bc4-e38e-455a-8031-6cb791c645b8 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:41.782288 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4bc4-e38e-455a-8031-6cb791c645b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:41.858725 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-05cb4bc4-e38e-455a-8031-6cb791c645b8 None None] MFA Rules not processed for user `f6aae5696d46443686c84424744ec36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:41.859958 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-05cb4bc4-e38e-455a-8031-6cb791c645b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:41.965516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 706/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 9 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:41.980557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e23d-a52f-4a6e-9d22-b6bd62ea6804 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:41.980844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e23d-a52f-4a6e-9d22-b6bd62ea6804 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:41.981117 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e23d-a52f-4a6e-9d22-b6bd62ea6804 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:41.982696 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 706/1412] 10.222.0.18 () {54 vars in 918 bytes} [Fri Sep 9 04:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:41.987404 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151073c-bf4d-480e-bf7c-1a2dfa81ca24 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:41.987691 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151073c-bf4d-480e-bf7c-1a2dfa81ca24 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:41.987964 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151073c-bf4d-480e-bf7c-1a2dfa81ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:42.062954 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:42.066552 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c151073c-bf4d-480e-bf7c-1a2dfa81ca24 None None] MFA Rules not processed for user `d2fb8c8ee6324e4ba6c328a9c2450fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:42.068027 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c151073c-bf4d-480e-bf7c-1a2dfa81ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:42.186348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 707/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 9 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:44.760134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fcaa4-20df-45ef-9d0a-e8ac944a11bf None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:44.760689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fcaa4-20df-45ef-9d0a-e8ac944a11bf None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:44.760689 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fcaa4-20df-45ef-9d0a-e8ac944a11bf None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:44.761996 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:44.767850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938f7e-4c23-4698-a577-91b50269b852 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:44.768286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938f7e-4c23-4698-a577-91b50269b852 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:44.768385 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938f7e-4c23-4698-a577-91b50269b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:44.835182 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-1d938f7e-4c23-4698-a577-91b50269b852 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:44.836378 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-1d938f7e-4c23-4698-a577-91b50269b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:44.891622 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:44.933277 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:45.222370 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fcaa4-20df-45ef-9d0a-e8ac944a11bf None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:45.223846 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-217fcaa4-20df-45ef-9d0a-e8ac944a11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:45.370849 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fcaa4-20df-45ef-9d0a-e8ac944a11bf None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:45.444488 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:45.485504 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:45.486031 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:45.486304 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:45.486570 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:45.488190 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:45.578942 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:45.580580 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66460167-0ffb-41e4-9da2-7c4769fd2c89 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:45.598224 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 708/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:46.750677 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213c9e3-7a9a-4a93-8027-b76607139808 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:46.751297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213c9e3-7a9a-4a93-8027-b76607139808 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:46.751297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213c9e3-7a9a-4a93-8027-b76607139808 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:46.752658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:46.758809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac5254-e084-4145-85b3-beadc2823906 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:46.759242 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac5254-e084-4145-85b3-beadc2823906 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:46.759392 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac5254-e084-4145-85b3-beadc2823906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:46.835046 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-f1ac5254-e084-4145-85b3-beadc2823906 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:46.836287 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-f1ac5254-e084-4145-85b3-beadc2823906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:46.862954 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:46.932409 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:47.085419 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213c9e3-7a9a-4a93-8027-b76607139808 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:47.086948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2213c9e3-7a9a-4a93-8027-b76607139808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:47.231377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213c9e3-7a9a-4a93-8027-b76607139808 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:47.274232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:47.346477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:47.347010 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:47.347315 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:47.347586 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:47.349178 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:47.440047 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:47.441665 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3eb34-e4da-43e9-bf9a-57e38fa8424e service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:47.459216 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 710/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:48.603082 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294de42-c822-4760-85e3-e4e8761f1579 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:48.603693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294de42-c822-4760-85e3-e4e8761f1579 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:48.603693 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294de42-c822-4760-85e3-e4e8761f1579 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:48.604914 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:48.611688 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3d85-9520-40c1-9957-ec917bffaa11 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:48.612189 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3d85-9520-40c1-9957-ec917bffaa11 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:48.612298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3d85-9520-40c1-9957-ec917bffaa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:48.665888 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:48.688787 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-83be3d85-9520-40c1-9957-ec917bffaa11 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:48.689990 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-83be3d85-9520-40c1-9957-ec917bffaa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:48.785255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:48.940446 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294de42-c822-4760-85e3-e4e8761f1579 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:48.942000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a294de42-c822-4760-85e3-e4e8761f1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:49.086542 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294de42-c822-4760-85e3-e4e8761f1579 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:49.099285 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:49.199961 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:49.200590 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:49.200882 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:49.201286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:49.202900 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:49.295936 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:49.297546 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4673e-e5f6-4be2-a9a0-708ae6163606 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:49.315776 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 711/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:50.437587 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc8b7-f54f-4958-9391-fe223fcbf6b0 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:50.438148 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc8b7-f54f-4958-9391-fe223fcbf6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:50.438148 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc8b7-f54f-4958-9391-fe223fcbf6b0 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:50.439557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:50.445933 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c2c7c-c1ec-4cb3-b736-6e14fd6557ae None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:50.446431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c2c7c-c1ec-4cb3-b736-6e14fd6557ae None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:50.446541 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c2c7c-c1ec-4cb3-b736-6e14fd6557ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:50.466474 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:50.524135 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-e30c2c7c-c1ec-4cb3-b736-6e14fd6557ae None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:50.525263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-e30c2c7c-c1ec-4cb3-b736-6e14fd6557ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:50.619431 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:50.770778 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc8b7-f54f-4958-9391-fe223fcbf6b0 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:50.772341 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-29fcc8b7-f54f-4958-9391-fe223fcbf6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:50.882941 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:50.918465 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc8b7-f54f-4958-9391-fe223fcbf6b0 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:51.028692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:51.029295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:51.029567 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:51.030093 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:51.031723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:51.108016 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:51.121557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:51.123885 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41330d-b365-4dde-9f53-3df9d4556430 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:51.142332 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 713/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:52.258934 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8168-4485-45c5-96f5-dc0a694d9ed0 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:52.259500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8168-4485-45c5-96f5-dc0a694d9ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:52.259500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8168-4485-45c5-96f5-dc0a694d9ed0 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:52.260844 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:52.267984 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb98ef-fcd4-4eef-a386-f3a25a7a85f4 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:52.268469 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb98ef-fcd4-4eef-a386-f3a25a7a85f4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:52.268567 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb98ef-fcd4-4eef-a386-f3a25a7a85f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:52.344764 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-5cdb98ef-fcd4-4eef-a386-f3a25a7a85f4 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:52.345914 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5cdb98ef-fcd4-4eef-a386-f3a25a7a85f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:52.441953 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:52.593554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8168-4485-45c5-96f5-dc0a694d9ed0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:52.595157 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-1aac8168-4485-45c5-96f5-dc0a694d9ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:52.680593 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:52.742871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8168-4485-45c5-96f5-dc0a694d9ed0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:52.854833 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:52.855388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:52.855664 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:52.855931 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:52.858547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:52.908388 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:52.949569 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:52.951485 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344d46-cca9-4208-bae9-5a8184b94da2 service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:52.969908 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 714/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:32:54.036301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbfb33-bfb6-4223-b939-445c629abc40 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:54.036867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbfb33-bfb6-4223-b939-445c629abc40 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:54.036867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbfb33-bfb6-4223-b939-445c629abc40 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:54.038186 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:54.044718 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a1e2-e5d4-4949-8b21-fd3922c26ea2 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:54.045150 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a1e2-e5d4-4949-8b21-fd3922c26ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:54.045420 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a1e2-e5d4-4949-8b21-fd3922c26ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:54.120559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-9ee7a1e2-e5d4-4949-8b21-fd3922c26ea2 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:54.121765 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-9ee7a1e2-e5d4-4949-8b21-fd3922c26ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:54.218436 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:54.368544 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbfb33-bfb6-4223-b939-445c629abc40 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:54.370011 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-34bbfb33-bfb6-4223-b939-445c629abc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:54.418763 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:54.517653 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbfb33-bfb6-4223-b939-445c629abc40 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:54.631559 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:54.632086 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:54.632363 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:54.632631 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:54.634257 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:54.641828 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:54.725388 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:54.726975 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8f4ca-c4c7-43fd-9830-c9c3b433cbe4 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:54.744574 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 716/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:55.797426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6965f0-af7d-424c-ad58-580c1de72ff0 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:55.797974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6965f0-af7d-424c-ad58-580c1de72ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:55.797974 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6965f0-af7d-424c-ad58-580c1de72ff0 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:55.799323 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:55.805510 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cba99-480d-4b00-9014-7af5a6fcea8f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:55.805925 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cba99-480d-4b00-9014-7af5a6fcea8f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:55.806053 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cba99-480d-4b00-9014-7af5a6fcea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:55.882857 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-b02cba99-480d-4b00-9014-7af5a6fcea8f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:55.884089 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-b02cba99-480d-4b00-9014-7af5a6fcea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:55.952482 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:55.981305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:56.134989 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6965f0-af7d-424c-ad58-580c1de72ff0 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:56.136467 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-2a6965f0-af7d-424c-ad58-580c1de72ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:56.153992 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:56.284603 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6965f0-af7d-424c-ad58-580c1de72ff0 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:56.373414 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:56.398841 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:56.399410 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:56.399685 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:56.399953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:56.401544 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:56.492858 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:56.494461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867e8cd-61b1-4015-bc1f-56bf6ff9f91b service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:56.512143 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 717/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:32:57.563533 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2e75-5baf-4443-874e-9175ac2143a1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:57.564042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2e75-5baf-4443-874e-9175ac2143a1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:57.564042 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2e75-5baf-4443-874e-9175ac2143a1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:57.565347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:57.571510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d640-eaba-473e-be05-0aaf40052ca6 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:57.571947 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d640-eaba-473e-be05-0aaf40052ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:57.572066 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d640-eaba-473e-be05-0aaf40052ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:57.646702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-fe31d640-eaba-473e-be05-0aaf40052ca6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:57.647945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-fe31d640-eaba-473e-be05-0aaf40052ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:57.689886 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:57.743958 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:57.893478 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac2e75-5baf-4443-874e-9175ac2143a1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:57.894909 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-31ac2e75-5baf-4443-874e-9175ac2143a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:58.040664 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac2e75-5baf-4443-874e-9175ac2143a1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:58.095761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:58.156310 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:58.156848 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:58.157134 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:58.157403 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:58.159009 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:58.249262 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:32:58.250877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b7e5-f424-4056-9ebf-6e150b8a1c68 service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:32:58.270099 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 719/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:59.318151 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ff86-adf6-4c9b-8675-2f55f3446686 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:59.318730 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ff86-adf6-4c9b-8675-2f55f3446686 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:59.318730 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ff86-adf6-4c9b-8675-2f55f3446686 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:59.320055 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 04:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:32:59.326747 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7895fe-f242-4c30-af2e-c2383e493849 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:59.327230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7895fe-f242-4c30-af2e-c2383e493849 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:59.327337 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7895fe-f242-4c30-af2e-c2383e493849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:59.402723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-3b7895fe-f242-4c30-af2e-c2383e493849 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:32:59.404516 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-3b7895fe-f242-4c30-af2e-c2383e493849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:59.406512 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:59.507366 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 04:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:32:59.656317 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964ff86-adf6-4c9b-8675-2f55f3446686 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:32:59.657831 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-2964ff86-adf6-4c9b-8675-2f55f3446686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:32:59.801871 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964ff86-adf6-4c9b-8675-2f55f3446686 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:32:59.830279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:59.915611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:32:59.916221 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:32:59.916500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:32:59.916767 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:32:59.918369 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:00.007758 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:00.009381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b95e6e-f065-463d-911d-29b548a7acaf service nova] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:00.027351 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 720/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:02.084891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea18044-576e-490e-a2dd-9fb5aff1de19 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:02.085442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea18044-576e-490e-a2dd-9fb5aff1de19 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:02.085442 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea18044-576e-490e-a2dd-9fb5aff1de19 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:02.086790 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:02.092081 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cee40-ebff-4c63-9a4b-f39ccc9a963a None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:02.092468 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cee40-ebff-4c63-9a4b-f39ccc9a963a None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:02.092623 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cee40-ebff-4c63-9a4b-f39ccc9a963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:02.133538 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:02.159079 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-071cee40-ebff-4c63-9a4b-f39ccc9a963a None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:02.160293 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-071cee40-ebff-4c63-9a4b-f39ccc9a963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:02.263571 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:02.555417 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea18044-576e-490e-a2dd-9fb5aff1de19 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:02.558312 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-6ea18044-576e-490e-a2dd-9fb5aff1de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:02.687449 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea18044-576e-490e-a2dd-9fb5aff1de19 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:02.733250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:02.783110 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:02.783721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:02.783998 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:02.784269 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:02.785933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:03.089545 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:03.091246 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88be92-df69-4a60-b1aa-ca809415b46d service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:03.110305 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 722/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:05.429645 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22fca9-19a4-4366-a14a-a3c0bf7c208e None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:05.430201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22fca9-19a4-4366-a14a-a3c0bf7c208e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:05.430201 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22fca9-19a4-4366-a14a-a3c0bf7c208e None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:05.431562 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:05.438120 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154d1f-b03c-498f-bfb3-f7576529d25f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:05.438564 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154d1f-b03c-498f-bfb3-f7576529d25f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:05.438675 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154d1f-b03c-498f-bfb3-f7576529d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:05.504699 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-0e154d1f-b03c-498f-bfb3-f7576529d25f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:05.505846 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-0e154d1f-b03c-498f-bfb3-f7576529d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:05.519609 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:05.602849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:05.889196 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22fca9-19a4-4366-a14a-a3c0bf7c208e None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:05.890729 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-aa22fca9-19a4-4366-a14a-a3c0bf7c208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:05.991618 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22fca9-19a4-4366-a14a-a3c0bf7c208e None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:06.004003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:06.068072 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:06.068671 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:06.068948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:06.069218 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:06.070815 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:06.184240 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:06.186916 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbefa3-e83d-4c64-a9a8-fc8d4b35ef2f service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:06.207625 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 723/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:08.690723 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0cb74-87d9-4bcb-bb61-c2ec4609ebc1 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:08.691282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0cb74-87d9-4bcb-bb61-c2ec4609ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:08.691282 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0cb74-87d9-4bcb-bb61-c2ec4609ebc1 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:08.692599 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:08.697784 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4860fab-8d4f-4dbe-b628-98507f0e9ccd None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:08.698226 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4860fab-8d4f-4dbe-b628-98507f0e9ccd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:08.698329 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4860fab-8d4f-4dbe-b628-98507f0e9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:08.745638 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:08.764735 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a4860fab-8d4f-4dbe-b628-98507f0e9ccd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:08.765935 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a4860fab-8d4f-4dbe-b628-98507f0e9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:08.860635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:09.144170 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0cb74-87d9-4bcb-bb61-c2ec4609ebc1 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:09.145721 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-50d0cb74-87d9-4bcb-bb61-c2ec4609ebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:09.250348 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0cb74-87d9-4bcb-bb61-c2ec4609ebc1 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:09.290294 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:09.325918 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:09.326463 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:09.326743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:09.327012 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:09.328642 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:09.438910 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:09.440287 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3906c-9b37-452c-8484-ab126a17d9e4 service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:09.458573 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 725/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:11.752704 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57625-4516-46f4-b301-2b44f2468d7d None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:11.753263 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57625-4516-46f4-b301-2b44f2468d7d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:11.753381 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57625-4516-46f4-b301-2b44f2468d7d None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:11.754648 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:11.759900 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffa68-8443-43ec-a8d6-b30241182e6f None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:11.760322 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffa68-8443-43ec-a8d6-b30241182e6f None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:11.760452 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cffa68-8443-43ec-a8d6-b30241182e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:11.826507 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-49cffa68-8443-43ec-a8d6-b30241182e6f None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:11.827737 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-49cffa68-8443-43ec-a8d6-b30241182e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:11.847948 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:11.926100 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:12.211439 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57625-4516-46f4-b301-2b44f2468d7d None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:12.212991 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-19f57625-4516-46f4-b301-2b44f2468d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:12.316808 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57625-4516-46f4-b301-2b44f2468d7d None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:12.344360 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:12.398050 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:12.398652 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:12.398929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:12.399239 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:12.400861 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:12.510766 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:12.512184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13cdca-0280-4404-85e3-c0198cbb98b3 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:12.531492 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 726/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:14.860252 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6b63-95cc-4b99-a236-cd7518ee50ec None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:14.860817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6b63-95cc-4b99-a236-cd7518ee50ec None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:14.860817 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6b63-95cc-4b99-a236-cd7518ee50ec None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:14.862135 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:33:14.867545 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd05b0-2938-4e1c-9b36-518fdf6771e6 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:14.867990 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd05b0-2938-4e1c-9b36-518fdf6771e6 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:14.868098 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd05b0-2938-4e1c-9b36-518fdf6771e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:14.933096 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:14.936866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-47fd05b0-2938-4e1c-9b36-518fdf6771e6 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:14.938244 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-47fd05b0-2938-4e1c-9b36-518fdf6771e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:15.032488 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:15.320794 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6b63-95cc-4b99-a236-cd7518ee50ec None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:15.322308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-e42c6b63-95cc-4b99-a236-cd7518ee50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:15.426528 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6b63-95cc-4b99-a236-cd7518ee50ec None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:15.476014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:15.500751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:15.501286 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:15.501561 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:15.501827 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:15.503448 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:15.611111 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:15.612534 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704808-984f-4c73-83f8-df2e9e01df7e service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:15.630582 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 728/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:17.830088 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f574-bc31-4a83-8b22-ea5dc8c4179a None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:17.830629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f574-bc31-4a83-8b22-ea5dc8c4179a None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:17.830629 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f574-bc31-4a83-8b22-ea5dc8c4179a None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:17.832000 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:17.837373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d0237-9053-4fe3-b763-5132e03afbcd None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:17.837815 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d0237-9053-4fe3-b763-5132e03afbcd None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:17.837912 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d0237-9053-4fe3-b763-5132e03afbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:17.904176 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c00d0237-9053-4fe3-b763-5132e03afbcd None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:17.905377 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c00d0237-9053-4fe3-b763-5132e03afbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:17.933896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:18.003320 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 04:33:18.292444 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f574-bc31-4a83-8b22-ea5dc8c4179a None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:18.294600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7416f574-bc31-4a83-8b22-ea5dc8c4179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:18.398159 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f574-bc31-4a83-8b22-ea5dc8c4179a None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:18.427537 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:18.473282 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:18.473890 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:18.474171 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:18.474443 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:18.476078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:18.586550 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:18.588119 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c624e-8eee-45c7-a7d0-faceb9300631 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:18.611210 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 729/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:20.844477 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0274ad-47fc-4b59-a135-2fde4eb474a4 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:20.845063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0274ad-47fc-4b59-a135-2fde4eb474a4 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:20.845063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0274ad-47fc-4b59-a135-2fde4eb474a4 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:20.846334 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:20.851688 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757160af-d9a5-4506-96f4-48763c090abe None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:20.852132 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757160af-d9a5-4506-96f4-48763c090abe None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:20.852236 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757160af-d9a5-4506-96f4-48763c090abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:20.918585 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-757160af-d9a5-4506-96f4-48763c090abe None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:20.920138 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-757160af-d9a5-4506-96f4-48763c090abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:20.928357 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:21.016753 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:21.300116 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0274ad-47fc-4b59-a135-2fde4eb474a4 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:21.301633 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-dd0274ad-47fc-4b59-a135-2fde4eb474a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:21.406159 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0274ad-47fc-4b59-a135-2fde4eb474a4 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:21.462957 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:21.482273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:21.482867 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:21.483175 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:21.483446 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:21.485031 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:21.595014 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:21.596390 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6301d2-6cb3-4cc8-8a5f-637a9c9fcc9e service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:21.614534 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 731/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:23.813078 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f43cd-c7d9-4f65-abeb-e425e1da627e None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:23.813620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f43cd-c7d9-4f65-abeb-e425e1da627e None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:23.813620 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f43cd-c7d9-4f65-abeb-e425e1da627e None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:23.814969 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:23.820251 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a65ca-5032-46bb-b148-18e89b95367d None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:23.820694 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a65ca-5032-46bb-b148-18e89b95367d None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:23.820868 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a65ca-5032-46bb-b148-18e89b95367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:23.885724 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-186a65ca-5032-46bb-b148-18e89b95367d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:23.886933 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-186a65ca-5032-46bb-b148-18e89b95367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:23.925473 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:23.985049 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:24.267411 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f43cd-c7d9-4f65-abeb-e425e1da627e None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:24.268953 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3a1f43cd-c7d9-4f65-abeb-e425e1da627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:24.371929 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f43cd-c7d9-4f65-abeb-e425e1da627e None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:24.410091 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:24.446428 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:24.447029 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:24.447334 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:24.447600 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:24.449185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:24.558454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:24.560124 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcfc6b-1715-454a-bfc8-538439211ecd service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:24.693565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 732/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:26.863268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11d32-7742-43dc-8362-07cc5abc0d7a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:26.863833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11d32-7742-43dc-8362-07cc5abc0d7a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:26.863833 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11d32-7742-43dc-8362-07cc5abc0d7a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:26.865196 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:26.870565 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469ff3-6062-4b40-8303-4cab48313f0b None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:26.870990 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469ff3-6062-4b40-8303-4cab48313f0b None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:26.871127 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469ff3-6062-4b40-8303-4cab48313f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:26.937959 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-25469ff3-6062-4b40-8303-4cab48313f0b None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:26.939186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-25469ff3-6062-4b40-8303-4cab48313f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:26.957134 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:27.034265 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:27.322635 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11d32-7742-43dc-8362-07cc5abc0d7a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:27.324209 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-9dd11d32-7742-43dc-8362-07cc5abc0d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:27.427824 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11d32-7742-43dc-8362-07cc5abc0d7a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:27.494529 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:27.501192 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:27.501790 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:27.502063 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:27.502329 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:27.503940 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:27.613736 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:27.615173 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbab594-1745-4b5c-8fc4-60a6304bf084 service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:27.633000 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 734/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:29.801611 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa6cc-09f8-4262-ae86-8a8c94107e6f None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:29.802148 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa6cc-09f8-4262-ae86-8a8c94107e6f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:29.802148 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa6cc-09f8-4262-ae86-8a8c94107e6f None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:29.803500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 04:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:29.808697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66cb59-b9d3-4d1c-b80f-391a848b28f8 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:29.809367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66cb59-b9d3-4d1c-b80f-391a848b28f8 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:29.809367 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66cb59-b9d3-4d1c-b80f-391a848b28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:29.874976 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-9a66cb59-b9d3-4d1c-b80f-391a848b28f8 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:29.876232 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-9a66cb59-b9d3-4d1c-b80f-391a848b28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:29.924692 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:29.974549 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:30.261530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa6cc-09f8-4262-ae86-8a8c94107e6f None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:30.263454 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-038aa6cc-09f8-4262-ae86-8a8c94107e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:30.366899 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa6cc-09f8-4262-ae86-8a8c94107e6f None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:30.419338 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:30.444948 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:30.445551 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:30.445826 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:30.446099 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:30.447737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:30.563489 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:30.564873 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff81ad3-b05b-4cd5-b4a3-066822fd5381 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:30.582666 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 735/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:39.972950 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=22 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:40.580456 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=66 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:50.851774 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab984513-b49a-4ecb-bca0-7b76e5dda55a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:50.852398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab984513-b49a-4ecb-bca0-7b76e5dda55a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:50.852398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab984513-b49a-4ecb-bca0-7b76e5dda55a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:50.853669 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 736/1471] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:50.859723 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4751751-57f6-49f2-b844-67202d13a986 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:50.860152 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4751751-57f6-49f2-b844-67202d13a986 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:50.860255 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4751751-57f6-49f2-b844-67202d13a986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:50.926365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-f4751751-57f6-49f2-b844-67202d13a986 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:50.927607 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-f4751751-57f6-49f2-b844-67202d13a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:51.022879 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 736/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:51.332898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814307be-80dd-4d53-bf38-834c4924bae3 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:51.333182 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814307be-80dd-4d53-bf38-834c4924bae3 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:51.333454 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814307be-80dd-4d53-bf38-834c4924bae3 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:51.334776 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 737/1473] 10.222.0.18 () {54 vars in 966 bytes} [Fri Sep 9 04:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:51.340248 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ba20-9fb3-4edb-a6a9-d13aa2e0a36d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:51.340557 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ba20-9fb3-4edb-a6a9-d13aa2e0a36d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:51.340825 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ba20-9fb3-4edb-a6a9-d13aa2e0a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:51.419765 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-0ad5ba20-9fb3-4edb-a6a9-d13aa2e0a36d None None] MFA Rules not processed for user `71f71f58204a4569bf6d937b6691c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:51.420985 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-0ad5ba20-9fb3-4edb-a6a9-d13aa2e0a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:51.442339 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:51.498554 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 737/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Fri Sep 9 04:33:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:51.506221 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814307be-80dd-4d53-bf38-834c4924bae3 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:51.507759 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-814307be-80dd-4d53-bf38-834c4924bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:51.612769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814307be-80dd-4d53-bf38-834c4924bae3 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:51.687140 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f71f58204a4569bf6d937b6691c2f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:51.687746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:51.688025 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:51.688297 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:51.689891 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:51.743220 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:51.799044 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:51.800434 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecc43e-03ae-4c74-acc4-bf352e722be6 service glance] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:51.818982 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 738/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:33:54.069814 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f1b9-bf93-4a35-a692-9555e8590bdd None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:54.070383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f1b9-bf93-4a35-a692-9555e8590bdd None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:54.070383 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f1b9-bf93-4a35-a692-9555e8590bdd None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:54.071717 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 738/1476] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:33:54.077128 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c53ab-3184-4d43-b27d-8352c477ce3e None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:54.077557 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c53ab-3184-4d43-b27d-8352c477ce3e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:54.077671 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c53ab-3184-4d43-b27d-8352c477ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:54.142992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-259c53ab-3184-4d43-b27d-8352c477ce3e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:54.144230 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-259c53ab-3184-4d43-b27d-8352c477ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:54.241439 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 739/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:54.515763 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f1b9-bf93-4a35-a692-9555e8590bdd None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:54.517313 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c619f1b9-bf93-4a35-a692-9555e8590bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:54.643674 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f1b9-bf93-4a35-a692-9555e8590bdd None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:54.693186 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:54.737026 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:54.737630 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:54.737905 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:54.738175 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] PATH_INFO: `/v3/projects` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:54.738809 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:54.740586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WARNING py.warnings [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:33:54.740586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: warnings.warn(msg) Sep 09 04:33:54.740586 dv-cinder-856002-3-smb devstack@keystone.service[81488]: Sep 09 04:33:54.741714 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530bfd3-3b65-4f03-8b67-5fa0aeffbadb admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:54.760528 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 739/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 9 04:33:54 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 04:33:56.942060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0889e-f990-4592-bf28-530648f648ff None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:56.942551 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0889e-f990-4592-bf28-530648f648ff None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:56.942644 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0889e-f990-4592-bf28-530648f648ff None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:56.943956 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 740/1479] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 04:33:56.949510 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2309da-8303-4747-b305-76beeb0955c5 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:56.949912 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2309da-8303-4747-b305-76beeb0955c5 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:56.950054 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2309da-8303-4747-b305-76beeb0955c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:57.014958 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-ce2309da-8303-4747-b305-76beeb0955c5 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:33:57.016184 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-ce2309da-8303-4747-b305-76beeb0955c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:57.111085 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 740/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:33:57.414293 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0889e-f990-4592-bf28-530648f648ff None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:33:57.415831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-65d0889e-f990-4592-bf28-530648f648ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:57.426319 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:57.561851 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0889e-f990-4592-bf28-530648f648ff None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:33:57.640849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:57.673069 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2fb8c8ee6324e4ba6c328a9c2450fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:33:57.673667 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:33:57.673945 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:33:57.674212 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:33:57.675831 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:33:57.764295 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:33:57.765859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01543d-221d-4946-b28b-fe80fa44f3dd service nova] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:33:57.784017 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 741/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:34:00.116559 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c58e-74ea-40eb-adc9-2471f6062e04 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:00.117118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c58e-74ea-40eb-adc9-2471f6062e04 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:00.117118 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c58e-74ea-40eb-adc9-2471f6062e04 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:00.118432 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 741/1482] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:34:00.124339 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c46bf-041a-43fa-8ed7-52b8917c9f3a None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:00.124769 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c46bf-041a-43fa-8ed7-52b8917c9f3a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:00.124877 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c46bf-041a-43fa-8ed7-52b8917c9f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:00.190837 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-c97c46bf-041a-43fa-8ed7-52b8917c9f3a None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:34:00.192077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c97c46bf-041a-43fa-8ed7-52b8917c9f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:00.239453 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:00.289352 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 742/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:34:00.580342 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c58e-74ea-40eb-adc9-2471f6062e04 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:34:00.581949 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-7067c58e-74ea-40eb-adc9-2471f6062e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:00.606560 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:00.686517 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c58e-74ea-40eb-adc9-2471f6062e04 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:34:00.759609 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:34:00.760247 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:00.760525 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:00.760797 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:00.763485 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:00.839041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:00.874041 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:34:00.875516 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d36cb-c28f-47d5-b4d7-969857ddf91d service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:34:00.893622 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 742/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:34:03.120250 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddaacc-2aa8-487c-bb5a-5b28f26f4034 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:03.120898 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddaacc-2aa8-487c-bb5a-5b28f26f4034 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:03.121092 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddaacc-2aa8-487c-bb5a-5b28f26f4034 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:03.122514 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 743/1485] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:34:03.127711 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835782a-733f-47a9-ab01-4e23a344441d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:03.128154 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835782a-733f-47a9-ab01-4e23a344441d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:03.128251 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835782a-733f-47a9-ab01-4e23a344441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:03.196986 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-5835782a-733f-47a9-ab01-4e23a344441d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:34:03.198188 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-5835782a-733f-47a9-ab01-4e23a344441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:03.295958 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 743/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:34:03.587521 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddaacc-2aa8-487c-bb5a-5b28f26f4034 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:34:03.589077 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-32ddaacc-2aa8-487c-bb5a-5b28f26f4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:03.692761 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddaacc-2aa8-487c-bb5a-5b28f26f4034 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:34:03.765829 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:03.767308 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:34:03.767920 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:03.768398 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:03.768872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:03.770663 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:03.878890 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:34:03.880273 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11febc-47b9-49f2-93ac-ebd65cc3b3f6 service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:34:03.898394 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 744/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:34:06.329461 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb3e5-ad38-40b7-afb3-051b8c9e339f None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:06.329982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb3e5-ad38-40b7-afb3-051b8c9e339f None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:06.329982 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb3e5-ad38-40b7-afb3-051b8c9e339f None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:06.331276 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 744/1488] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:34:06.336581 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc826a02-3b70-4611-b5a4-11bfaa79367e None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:06.336983 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc826a02-3b70-4611-b5a4-11bfaa79367e None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:06.337147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc826a02-3b70-4611-b5a4-11bfaa79367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:06.405760 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-dc826a02-3b70-4611-b5a4-11bfaa79367e None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:34:06.407429 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-dc826a02-3b70-4611-b5a4-11bfaa79367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:06.463204 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:06.511444 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 745/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:34:06.805426 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb3e5-ad38-40b7-afb3-051b8c9e339f None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:34:06.806981 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-cddcb3e5-ad38-40b7-afb3-051b8c9e339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:06.843581 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:06.910805 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb3e5-ad38-40b7-afb3-051b8c9e339f None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:34:06.982917 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:34:06.983537 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:06.983832 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:06.984087 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:06.985647 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:07.064110 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:07.093053 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:34:07.094505 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06826c83-8fab-4c1f-a8b3-f782031d7067 service neutron] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:34:07.112246 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 745/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:34:09.453011 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36006c36-2b9c-4bb4-9e31-bad223ba394a None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:09.453540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36006c36-2b9c-4bb4-9e31-bad223ba394a None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:09.453540 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36006c36-2b9c-4bb4-9e31-bad223ba394a None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:09.454874 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 746/1491] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 9 04:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:34:09.460303 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77faea5-3d1c-4f96-b00b-4fd70b3aa69d None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:09.460722 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77faea5-3d1c-4f96-b00b-4fd70b3aa69d None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:09.460862 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77faea5-3d1c-4f96-b00b-4fd70b3aa69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:09.528793 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-d77faea5-3d1c-4f96-b00b-4fd70b3aa69d None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:34:09.530012 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-d77faea5-3d1c-4f96-b00b-4fd70b3aa69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:09.626176 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 746/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 9 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:34:09.918127 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36006c36-2b9c-4bb4-9e31-bad223ba394a None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:34:09.919710 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-36006c36-2b9c-4bb4-9e31-bad223ba394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:10.024601 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36006c36-2b9c-4bb4-9e31-bad223ba394a None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:34:10.098882 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:34:10.099513 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:34:10.099793 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:34:10.100060 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:34:10.101647 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:34:10.110672 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:10.210129 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:34:10.211605 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a144-8076-4f39-ab31-226468470e72 service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:34:10.231493 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 747/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 04:34:19.624732 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=82 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:34:20.228648 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=50 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:24.479497 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:24.480092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:24.480092 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:24.557057 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:35:24.558192 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:24.652878 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 747/1494] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 9 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:35:24.660783 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:24.661272 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:24.661373 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:24.737075 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.auth.core [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:35:24.738271 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:24.833284 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 748/1495] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 9 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:35:24.838515 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:24.839733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:24.850932 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b29d1d-9adf-4f85-9a35-9db0ec87f373 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:24.916530 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:24.951854 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:24.952463 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:24.952737 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:24.953003 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] PATH_INFO: `/v3/domains` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:24.953635 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 04:35:24.953930 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:24.954941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WARNING py.warnings [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:24.954941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: warnings.warn(msg) Sep 09 04:35:24.954941 dv-cinder-856002-3-smb devstack@keystone.service[81488]: Sep 09 04:35:24.955866 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:24.967702 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 748/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 9 04:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 04:35:24.975960 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:24.985353 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc6f5b-a5df-4d0b-bbfb-702aff1601e3 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:25.046150 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:25.080141 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:25.080743 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.081032 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.081291 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.081930 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:25.083751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WARNING py.warnings [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:25.083751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: warnings.warn(msg) Sep 09 04:35:25.083751 dv-cinder-856002-3-smb devstack@keystone.service[81489]: Sep 09 04:35:25.084896 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:25.140960 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 749/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 9 04:35:24 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:35:25.145168 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:25.146677 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:25.181131 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273ad3-83df-4eb9-899f-c11d119ed76c admin admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:25.274710 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:25.275601 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.276107 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.276382 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] PATH_INFO: `/v3/users` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.277002 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:25.278011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WARNING py.warnings [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:25.278011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: warnings.warn(msg) Sep 09 04:35:25.278011 dv-cinder-856002-3-smb devstack@keystone.service[81488]: Sep 09 04:35:25.279241 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:25.322017 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 749/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 9 04:35:25 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 04:35:25.326133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:25.327689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:25.390214 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00edc9-81c6-48d3-96ec-77f3533febe7 admin admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:25.473579 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:25.486387 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:25.486992 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.487306 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.487576 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.488217 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:25.489222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WARNING py.warnings [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:25.489222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: warnings.warn(msg) Sep 09 04:35:25.489222 dv-cinder-856002-3-smb devstack@keystone.service[81489]: Sep 09 04:35:25.490133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:25.503072 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 750/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 9 04:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 04:35:25.507051 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:25.508824 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:25.520097 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869d50c-ff83-4c93-872f-4120da2e37fc admin admin] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:25.545975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:25.615587 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:25.616187 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.616464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.616733 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.617366 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:25.618643 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WARNING py.warnings [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:25.618643 dv-cinder-856002-3-smb devstack@keystone.service[81488]: warnings.warn(msg) Sep 09 04:35:25.618643 dv-cinder-856002-3-smb devstack@keystone.service[81488]: Sep 09 04:35:25.619547 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bbe87-84b6-41f0-a9af-3abb70712dd0 admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:25.631975 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 750/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 9 04:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 04:35:25.636301 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:25.637844 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:25.671937 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d177-263e-44ab-aa17-f37f1a15b681 admin admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:25.764211 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:25.764859 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.765133 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.765397 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] PATH_INFO: `/v3/projects/cfa3296f62d84db4a8a8b8a999770801/users/c4539222521c449e9e5146f88e193878/roles/625fe8b2be3e4e07bcd4a24aba0dce2d` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.787618 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa3296f62d84db4a8a8b8a999770801, user_id=c4539222521c449e9e5146f88e193878, role_id=625fe8b2be3e4e07bcd4a24aba0dce2d)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:25.788658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WARNING py.warnings [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:25.788658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: warnings.warn(msg) Sep 09 04:35:25.788658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: Sep 09 04:35:25.791298 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411ccf-58cb-4adc-b425-4190be4ada0b admin admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:25.815658 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 751/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 9 04:35:25 2022] PUT /identity/v3/projects/cfa3296f62d84db4a8a8b8a999770801/users/c4539222521c449e9e5146f88e193878/roles/625fe8b2be3e4e07bcd4a24aba0dce2d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:35:25.827954 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493588af-4d48-4f07-a4c2-3a1cd8301a31 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.828238 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493588af-4d48-4f07-a4c2-3a1cd8301a31 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.828508 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493588af-4d48-4f07-a4c2-3a1cd8301a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.884987 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-493588af-4d48-4f07-a4c2-3a1cd8301a31 None None] MFA Rules not processed for user `c4539222521c449e9e5146f88e193878`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:35:25.886178 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-493588af-4d48-4f07-a4c2-3a1cd8301a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:25.964464 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 751/1502] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 9 04:35:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:35:25.977697 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9214-58cb-4ff3-bfe7-8bfc02e66d93 None None] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.977981 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9214-58cb-4ff3-bfe7-8bfc02e66d93 None None] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.978255 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9214-58cb-4ff3-bfe7-8bfc02e66d93 None None] PATH_INFO: `/` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:25.979705 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 752/1503] 10.222.0.18 () {54 vars in 964 bytes} [Fri Sep 9 04:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:35:25.984418 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8060155-54cb-4a62-a5b8-f77bdeb3b8b0 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:25.984706 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8060155-54cb-4a62-a5b8-f77bdeb3b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:25.984981 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8060155-54cb-4a62-a5b8-f77bdeb3b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:26.017104 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:26.065820 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-a8060155-54cb-4a62-a5b8-f77bdeb3b8b0 None None] MFA Rules not processed for user `9f896dfbd2ad452e9def2c11cfa97e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:35:26.067021 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-a8060155-54cb-4a62-a5b8-f77bdeb3b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:26.141755 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 752/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Fri Sep 9 04:35:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 04:35:26.149563 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9214-58cb-4ff3-bfe7-8bfc02e66d93 None None] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:26.151084 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-70ff9214-58cb-4ff3-bfe7-8bfc02e66d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:26.202428 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:26.260268 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9214-58cb-4ff3-bfe7-8bfc02e66d93 None None] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:26.333368 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f896dfbd2ad452e9def2c11cfa97e53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:26.333970 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:26.334244 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:26.334511 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:26.336147 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:26.436256 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:26.437680 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:26.441171 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:26.456283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 753/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:35:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:35:26.502425 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed02ef-d2a7-4c77-943d-6a8a7e584058 None None] REQUEST_METHOD: `GET` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:26.502719 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed02ef-d2a7-4c77-943d-6a8a7e584058 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:26.502999 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed02ef-d2a7-4c77-943d-6a8a7e584058 None None] PATH_INFO: `/` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:26.504271 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 753/1506] 10.222.0.18 () {52 vars in 830 bytes} [Fri Sep 9 04:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 04:35:26.507777 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:26.508994 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:26.608710 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040748-a4f4-4f0f-837e-cdc7f3849173 service cinder] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:26.701689 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:26.702347 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:26.702578 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:26.702850 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] PATH_INFO: `/v3/users/c4539222521c449e9e5146f88e193878` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:26.716525 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4539222521c449e9e5146f88e193878)` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:26.717541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: WARNING py.warnings [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:26.717541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: warnings.warn(msg) Sep 09 04:35:26.717541 dv-cinder-856002-3-smb devstack@keystone.service[81489]: Sep 09 04:35:26.718746 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:26.729248 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=100 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:26.786401 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4539222521c449e9e5146f88e193878'} {{(pid=81489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:26.799796 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4539222521c449e9e5146f88e193878'} {{(pid=81489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:26.822872 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4539222521c449e9e5146f88e193878'} {{(pid=81489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:26.823461 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4539222521c449e9e5146f88e193878'} {{(pid=81489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:26.823889 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.notifications [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4539222521c449e9e5146f88e193878'} {{(pid=81489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:26.839210 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 754/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 9 04:35:26 2022] DELETE /identity/v3/users/c4539222521c449e9e5146f88e193878 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:35:26.843782 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] REQUEST_METHOD: `POST` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:26.844262 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:26.844365 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:26.901279 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.auth.core [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] MFA Rules not processed for user `408c4550159c4ddc8a18898824740b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 04:35:26.902477 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:26.978880 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=100 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:26.990945 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 754/1508] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 9 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 04:35:27.000936 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Authenticating user token {{(pid=81489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:27.002163 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:27.103283 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa806d-f896-4e9f-aa50-9a4607b84360 admin admin] Validating token access rules against request {{(pid=81489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:27.157125 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:27.178240 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee9e5824883448c9b52a0e292edf1e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49baaedc16c64edc915fbb9450b19c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:27.178849 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] REQUEST_METHOD: `GET` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:27.179153 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] SCRIPT_NAME: `/identity` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:27.179426 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:27.181720 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.fernet_utils [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:27.289280 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:27.290865 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951d39-7097-4d6e-b073-4ffe94fd564c service neutron] RBAC: Authorization granted {{(pid=81489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:27.309001 dv-cinder-856002-3-smb devstack@keystone.service[81489]: [pid: 81489|app: 0|req: 755/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 9 04:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 04:35:27.677938 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] Authenticating user token {{(pid=81488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 04:35:27.679250 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.fernet_utils [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 04:35:27.691500 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70487f3-5adb-4128-8305-98c23b3de195 None None] Validating token access rules against request {{(pid=81488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 04:35:27.794280 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408c4550159c4ddc8a18898824740b43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce92404f91b4778925ef74e27275875', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 04:35:27.794902 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 04:35:27.795209 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 04:35:27.795479 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] PATH_INFO: `/v3/projects/cfa3296f62d84db4a8a8b8a999770801` {{(pid=81488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 04:35:27.805198 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa3296f62d84db4a8a8b8a999770801)` {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 04:35:27.806865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: WARNING py.warnings [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 04:35:27.806865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: warnings.warn(msg) Sep 09 04:35:27.806865 dv-cinder-856002-3-smb devstack@keystone.service[81488]: Sep 09 04:35:27.808079 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] RBAC: Authorization granted {{(pid=81488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 04:35:27.865081 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa3296f62d84db4a8a8b8a999770801', 'request_id': 'req-8d595cc2-7209-4187-b1c4-b2964c51336b'} {{(pid=81488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:27.874884 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa3296f62d84db4a8a8b8a999770801', 'request_id': 'req-8d595cc2-7209-4187-b1c4-b2964c51336b'} {{(pid=81488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:27.889553 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa3296f62d84db4a8a8b8a999770801', 'request_id': 'req-8d595cc2-7209-4187-b1c4-b2964c51336b'} {{(pid=81488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:27.912286 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] The token cache is being invalidate because project cfa3296f62d84db4a8a8b8a999770801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 04:35:27.912574 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:27.913100 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG keystone.notifications [None req-8d595cc2-7209-4187-b1c4-b2964c51336b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 04:35:27.914396 dv-cinder-856002-3-smb devstack@keystone.service[81488]: [pid: 81488|app: 0|req: 755/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 9 04:35:27 2022] DELETE /identity/v3/projects/cfa3296f62d84db4a8a8b8a999770801 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 04:35:37.306784 dv-cinder-856002-3-smb devstack@keystone.service[81489]: DEBUG dbcounter [-] [81489] Writing DB stats keystone:SELECT=62 {{(pid=81489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:35:37.910185 dv-cinder-856002-3-smb devstack@keystone.service[81488]: DEBUG dbcounter [-] [81488] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}